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INTRODUCTION 


I  . 

In  1983  President  Ronald  Reagan  announced  the 
Strategic  Defense  Initiative  (SDI),  a  program  that 
called  for  an  Intensive  research  and  development  effort 
In  space  weapons  technology.  The  primary  objective  of 
the  Initiative  Is  to  produce  a  system  of  defensive 
weapons  capable  of  defending  the  United  States  and  Its 
allied  countries  from  hostile  ballistic  missile 
Infiltration;  to  create  an  Impenetrable  shield  composed 
of  high  technology  defensive  weapons.  President  Reagan 
believed  It  was  time  to  pursue  such  a  program  based  on 
his  ass\imptlon  that  the  United  States  had  the 
technological  potential  to  bring  his  goal  to  reality. 

A.  SDI  LONG  AND  SHORT  RANGE  GOALS 

The  President’s  Initial  SDI  objective  statement  Is 
now  recognized  as  the  long  range  goal  of  the  SDI 
program  [Ref.  1].  By  conducting  a  vigorous  research 
and  development  (R&D)  program,  It  Is  hoped  that  the 
threat  posed  by  ballistic  missiles  will  be  eliminated, 
thereby  deterring  aggression  and  promoting  security  and 
stability  throughout  the  world. 

The  short  range  goal  of  the  SDI  has  been 
established  as  well.  Before  proceeding  with  the  full- 
scale  production  of  the  defensive  system,  an  Initial 
period  of  Intensive  R&D  must  be  conducted.  A  target 
date  of  1995  has  been  established  for  the  completion  of 
this  Initial  phase  to  determine  the  physical  and 
economic  feasibility  of  the  proposed  system.  The 
short  range  goal  of  the  SDI  Is  to  provide  the  technical 
knowledge  needed  to  support  an  Informed  decision  by 
1995  on  whether  or  not  to  deploy  a  strategic  space 
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defense  against  ballistic  missiles.  This  decision  is 
called  the  Full  Scale  Engineering  Decision  (FSED). 

B.  SDI  ORGANIZATION  AND  PROJECT  FUNDING  METHODS 

The  SDI  proposal  led  to  the  creation  of  the 
Strategic  Defense  Initiative  Organization  (SDIO)  as  the 
organization  responsible  for  carrying  out  both 
objectives  of  the  initiative.  An  Army  unit  was 
established  to  manage  and  direct  Army  activities  In 
support  of  the  SDI.  This  unit,  the  US  Army  Strategic 
Defense  Command  (USASDC),  is  headquartered  in 
Washington,  DC,  and  commanded  by  LTG  John  Wall. 
Additionally,  the  US  Army  Ballistic  Missile  Command  in 
Huntsville,  Alabama,  was  reorganized  under  the  USASDC, 
since  this  command  was  responsible  for  many  of  the 
technological  developments  that  stimulated  the  SDI. 

As  will  be  discussed  in  detail  in  the  next  chapter, 
the  USASDC  does  not  use  a  project  funding  model  to 
assist  in  determining  the  funding  levels  for  the  many 
projects  they  manage.  The  budgeting  methods  presently 
used  are  almost  entirely  subjective,  relying  on  expert 
opinion  and  Informal  prioritization  techniques  to 
determine  project  funding  levels  each  year,  depending 
on  the  approved  budget  from  Congress. 

C.  STUDY  OBJECTIVE  AND  ORGANIZATION 

It  is  the  primary  objective  of  this  study  to 
develop  an  R&D  project  funding  model  of  the  presently 
funded  major  USASDC  R&D  projects.  This  model  will 
determine  optimum  expenditure  levels  for  each  major 
project  in  FY  88,  based  on  the  long  and  short  range 

ft 

goals  of  the  SDI  and  the  project  development  goals  that 
will  be  generated  in  Chapter  II.  The  model  used  to 
meet  this  objective  should  preferably  have  a  wide  range 
of  flexibility  and  apply  to  each  possible  budget 


strategy.  Results  from  this  model  will  be  compared 
against  presently  forecasted  FY  88  funding  levels  In 
order  to  test  the  validity  of  the  subjective  methods 
presently  employed. 

This  paper  Is  organized  to  logically  discuss  the 
modelling  process  and  results.  Chapter  II  is  devoted 
to  additional  background  Information  critical  to  the 
model  selection  and  execution.  The  third  chapter  will 
consist  of  a  search  for  the  most  appropriate  project 
funding  model  among  all  such  models  currently  used  in 
the  operations  research  literature.  Chapters  IV  and  V 
will  examine  the  development  and  formulation  of  the 
model  being  Implemented,  and  Chapter  VI  will  present 
the  computer  programs  written  to  perform  the  model. 
Additionally,  the  sixth  chapter  will  tender  model 
results  and  output.  Chapter  VII  will  be  reserved  for  a 
deliberation  on  the  model  sensitivity  and  validity. 
The  final  chapter  will  present  conclusions  and 
recommendations . 


This  chapter  Is  Intended  to  discuss  in  detail  those 
items  of  background  information  that  are  critical  to 
the  development  of  an  R&D  project  funding  model  of  the 
USASDC .  This  Includes  the  SDI  program  element 
structure,  the  present  project  development  process,  and 
the  specific  project  funding  goals  that  have  been 
established  by  key  management  personnel  of  the  SDIO  and 
USASDC . 

A.  SDI  PROGRAM  ELEMENTS 

Given  the  structure  reviewed  in  the  previous 
chapter,  a  technical  program  has  now  been  defined  and 
implemented.  R&D  efforts  are  structured  into  five 
program  elements,  each  element  examining  equally 
Important  SDI  technology.  Many  of  these  programs  have 
already  been  responsible  for  some  outstanding 
experimental  results.  The  five  program  elements  are; 
(1)  the  Surveillance,  Acquisition,  Tracking  and  Kill 
Assessment  ( SATKA )  program;  (2)  the  Directed  Energy 
Weapons  (DEW)  program;  (3)  the  Kinetic  Energy  Weapons 
(KEW)  program;  (4)  the  Systems  Analysis  and  Battle 
Management  (SABM)  program;  and  (5)  the  Survivability, 
Lethality  and  Key  Technologies  ( SLKT )  program.  A 
complete  description  of  each  program  element  can  by 
found  in  Appendix  A. 

B.  PROJECT  DEVELOPMENT 

The  USASDC  has  the  responsibility  of  directing  the 
research  and  development  process  for  all  Army-related 
SDI  projects.  Official  funding  for  a  particular 
project  does  not  begin  until  a  research  objective  is 
specified  in  a  Work  Package  Directive  (WPD).  The  WPD 
is  a  critical  document  that  contains  basic 


administrative  information  and  funding  authority. 
There  are  presently  over  seventy  WPDs  being  managed  by 
the  USASDC ;  thirty-five  can  be  categorized  as  major 
WPDs,  since  they  Involve  annual  spending  of  over  $5 
million  or  are  considered  high  priority  (see  Appendix  B 
for  a  description  of  each).  The  focal  point  for 
project  management  at  the  USASDC  headquarters  is  the 
Program  Analysis  and  Evaluation  (PAE)  directorate. 

The  USASDC  PAE  shop  is  organized  on  program  element 
lines:  SATKA,  SLKT ,  SABM,  KEW,  and  DEW.  Program 
element  managers  In  these  sections  manage  the  WPDs,  In 
conjunction  with  the  program  managers  and  technical 
personnel  located  at  research  facilities  throughout  the 
worldwide  R&D  community.  PAE  program  element  managers 
are  highly  educated  and  have  broad  technical  and 
managerial  backgrounds.  They  must  understand  the 
Intricacies  of  the  R&D  process  In  the  field  In  order  to 
make  correct  recommendations  to  decision  makers.  The 
most  difficult  and  Important  aspect  of  the  program 
element  managers  Job  Involves  the  allocation  of  funds 
to  the  projects  In  their  respective  program  element 
areas . 

Presently  there  is  no  formal  project  and  funding 
model  being  used  by  the  USASDC.  Rather,  project 
funding  is  based  on  a  document  [Ref.  2]  that  lists  the 
WPDs  in  priority  order  and  forecasts  funding  levels 
through  1994.  The  priority  listing  Is  put  together  by 
project  management  personnel  at  both  the  USASDC 
headquarters  in  Washington  and  Huntsville,  and  Is  based 
on  subjective  guidance,  recommendations,  and 
Information  from  R&D  personnel  involved  In  SDI 
development  worldwide.  A  key  feature  of  the  priority 
list  is  that  It  changes  according  to  four  different 
budgeting  strategies.  USASDC  planners  realize  that 


overall  funding  for  the  SDI  Is  subject  to  congressional 
debate  and  approval,  and  It  Is  difficult  to  predict  the 
approved  funding  level  for  politically  controversial 
programs.  Therefore,  budget  planners  have  Identified 
the  following  funding  strategies; 

1.  Core  -  the  level  required  to  provide  a  high 
risk  FSED  In  the  late  1990's. 

2.  Basic  -  the  level  required  to  provide  a 
reliable  FSED  In  the  late  1990's. 

3.  Enhanced  -  the  level  required  to  provide  a 
reliable  FSED  In  1995. 

4.  Extended  -  the  level  required  to  provide  a 
reliable  FSED  In  the  early  1990’s. 

Particularly  noteworthy  Is  the  fact  that  the  core 
and  basic  funding  levels  are  not  sufficient  to  meet  the 
short  term  goal  of  an  FSED  in  1995;  the  enhanced  and 
extended  levels  are  the  desired  funding  levels  for  the 
USASDC .  A  consistent  long  term  funding  strategy  Is  not 
likely  to  be  adopted  by  Congress  In  the  near  future,  so 
USASDC  planners  must  be  flexible. 

C.  PROJECT  FUNDING  GOALS 

As  stated  earlier  In  this  chapter,  the  long  range 
goal  of  the  SDI  Is  to  ultimately  develop  a  high 
technology  defensive  shield  against  hostile  ballistic 
missile  attack.  The  short  range  goal  is  to  reach  the 
FSED  not  later  than  1995.  Projects  selected  for 
development,  or  continued  development,  must  support 
these  two  goals.  Specifically,  projects  should  exhibit 
the  following  characteristics  In  order  to  contribute  to 
the  attainment  of  short  range  and  long  range  goals: 

1.  Maximize  military  effectiveness 

2.  Minimize  project  development  risk 

3.  Minimize  project  development  time 

4.  Maximize  project  development  balance 


The  next  four  sections  will  discuss  these  desired 
sub-goals  and  the  factors  that  Influence  the  attainment 
of  these  goals. 

1 .  Maximize  military  effectiveness 

A  project  will  not  be  selected  for  funding 
unless  It  contributes  to  the  achievement  of  the  overall 
military  mission  of  the  SDI .  There  are  three  ways  In 
which  a  project  can  make  such  a  contribution.  The 
first  Is  that  the  project  can  augment  the  achievement 
of  the  long  range  goal  of  the  SDI;  the  project  can 
assist  In  a  defense  against  attacking  ballistic 
missiles.  This  defense  must  be  designed  to  destroy  so 
many  hostile  missiles  that  an  aggressor  will  be 
deterred  from  launching  them.  The  degree  to  which  a 
project  aids  the  survivability,  destructlblllty , 
supportablllty ,  and/or  reliability  of  the  SDI  defensive 
system  Is  a  critical  characteristic  that  must  be 
evaluated  prior  to  funding  decisions. 

The  second  manner  In  which  a  project  can 
contribute  to  the  military  effectiveness  of  the  SDI 
program  concerns  the  SDI  short-range  goal;  the  project 
can  support  the  achievement  of  an  FSED  by  1995.  An 
Informed  FSED  will  require  a  great  deal  of  technical 
and  tactical  Information.  Many  projects  perform  R&D 
tasks  that  are  designed  to  support  the  FSED,  so  a 
project’s  potential  contribution  in  this  area  must  be 
considered . 

The  final  constituent  of  military 
effectiveness  Involves  the  potential  generation  of 
military  spinoff  technology.  Military  spinoff 
technology  Is  a  technological  advance  that  benefits 
military  objectives  other  than  those  associated  with 
the  SDI.  For  example,  advances  stimulated  by  an  SDI 
research  project  on  space  target  hardening  would 


certainly  be  carried  over  to  ground  and  sky  target 
hardening  projects  not  be  related  to  SDI .  The  space 
program  of  the  1960 's  and  1970 's  led  to  a  great  many 
technological  breakthroughs  that  benefitted  many  other 
facets  of  the  military  world;  one  would  expect  the  SDI 
program  to  similarly  Induce  useful  spinoff  technology. 
The  potential  for  generating  additional  military 
benefits  Is  a  project  characteristic  that  must  also  be 
considered  prior  to  funding  decisions. 

To  sximmarlze,  the  three  components  of  the 
military  effectiveness  goal  are:  (1)  maximize  the 
potential  contribution  to  the  SDI  long  range  goal  of 
building  a  missile  defense  system;  (2)  maximize  the 
potential  contribution  to  the  SDI  short  range  goal  of 
reaching  an  FSED  by  1995;  and  (3)  maximize  the 
potential  generation  of  military  spinoff  technology. 

2 .  Minimize  project  development  risk 

Each  project  In  SDI  has  a  degree  of  risk 
associated  with  It;  some  projects  are  more  likely  to 
achieve  success  than  others.  It  Is  advantageous  to  any 
financial  strategy  to  fund  projects  that  involve  the 
least  amount  of  risk.  There  are  two  separate  types  of 
risk  that  are  associated  with  each  project  that  must  be 
considered  during  the  funding  process:  technological 
risk  and  milestone  risk. 


Many  projects  require  the  development  of 
radically  new  technology,  whereas  others  Involve 
established  and  proven  scientific  Ideas.  Technological 
risk  addresses  the  technical  or  scientific  uncertainty 
affiliated  with  each  R&D  project;  the  likelihood  of 
falling  to  meet  the  ultimate  technical  objectives  of 
the  WPD.  A  venture  that  relies  on  the  development  of 
unproven  technology  In  order  to  achieve  Its  goal  poses 
a  risk  to  the  SDI  Investment  scheme.  The  technological 


risk  must  be  considered  prior  to  making  a  funding 
decision  regarding  a  project. 

Milestone  risk  involves  the  milestone  schedule 
that  is  listed  in  each  ¥PD.  Projects  are  given  target 
dates  in  which  to  reach  certain  developmental  plateaus. 
Milestone  risk  is  the  likelihood  of  falling  to  meet  the 
target  date  schedule  specified  in  the  WPD;  this  risk  is 
critical  to  the  overall  success  of  the  SDI ,  since  many 
projects  are  Interrelated. 

It  is  Important  to  differentiate  the  two  types 
of  risk  Involved  with  SDI.  A  project  might  have  a  very 
low  technological  risk,  but  represent  a  high  milestone 


risk  if  it  depended  on  the  performance  of  tasks  that 
are  technologically  easy,  but  operationally  difficult. 
The  two  components,  therefore,  of  the  goal  to  minimize 
risk  are:  (1)  minimize  technological  risk;  and  (2) 
minimize  milestone  risk. 

3.  Minimize  project  development  time 


The  third  major  desired  characteristic  of  an 
SDI  project  is  that  it  should  minimize  project 
development  time.  There  are  two  constituents  of 
project  development  time.  The  first  concerns  the  time 
required  to  achieve  ultimate  project  success.  SDI 
projects  demand  varying  lengths  of  time  in  order  to 
accomplish  the  goals  of  the  research.  It  is  difficult 
to  predict  the  time  required  for  many  projects, 
particularly  those  that  Involve  new  technology. 
Nonetheless,  the  estimation  and  minimization  of  this 
time  is  important,  since  the  missile  threat  posed  by 
Warsaw  Pact  countries  is  becoming  Increasingly 
sophisticated.  It  does  not  make  sense  to  spend  money 
on  a  project  that  would  require  an  excessive  amount  of 
time  to  properly  research  and  develop. 
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The  second  facet  of  project  development  time 
that  should  be  considered  In  project  funding  decisions 
Is  the  time  required  to  achieve  the  project  objectives 
needed  for  an  FSED.  The  desire  to  reach  an  Informed 
FSED  by  1995  (the  short  range  goal  of  the  SDI )  has 
already  been  discussed.  The  FSED  requires  Information 
on  the  feasibility  of  each  project.  The  time  required 
to  conduct  the  research  needed  to  provide  this 
information  will  vary.  Many  projects  that  Involve 
proven  technology  can  be  expected  to  achieve  the 
project  objectives  needed  for  an  FSED  very  quickly, 
whereas  other  projects  will  contribute  to  the  FSED 
slowly.  Projects  that  need  a  short  time  to  perform  the 
required  FSED  research  should  be  encouraged. 

The  two  sub-goals  of  the  minimize  development 
time  goal  are  as  follows:  (1)  minimize  ultimate  project 
success  time,  and  (2)  minimize  FSED  contribution  time. 

4 .  Maximize  project  development  balance 

A  balanced  research  and  development  SDI 
program  is  a  theme  that  has  been  expressed  repeatedly 
in  the  USASDC  1986  Report  to  Congress  [Ref.  1]  and  by 
key  leaders  In  the  USASDC.  The  1986  Budget  Priorities 
briefing  [Ref.  3]  lists  four  elements  of  the  Balanced 
Technology  Program  (BTP):  technology  base,  concepts  and 
designs,  data  collection  and  signature  measurements, 
and  function  performance.  It  is  desired  that  a  proper 
balance  of  funding  to  these  research  elements  be 
achieved  and  maintained. 

Technology  base  scientific  work  encompasses 
work  that  is  both  basic  and  applied  research.  Some 
technology  base  efforts  Involve  relatively 
straightforward  extensions  of  existing  technology;  It 
also  Includes  high  risk,  high  payoff  efforts.  The 


technology  base  program  is  Intended  to  foster  the  birth 


of  many  innovative  Ideas.  It  is  important  that  enough 
projects  in  this  category  are  supported  so  that  the  SDI 
program  continues  to  develop  new  technology  and  does 
not  stagnate.  The  work  done  in  the  technology  base 
phases  are  refined  in  the  concepts  and  designs  research 
phase.  Specific  ideas  regarding  problem  solutions  and 
equipment  designs  are  formulated  In  writing  and  an 
experimental  procedure  Is  postulated.  Data  collection 
and  signature  requirements  Involve  proof-of- 
feaslbility  experiments  to  support  or  refute  the  Ideas 
stated  In  the  concepts  and  design  phase.  Many  projects 
In  this  category  are  critical  to  the  goal  of  an 
Informed  FSED  by  1995.  The  function  performance  phase 
involves  experiments  that  demonstrate  the  capabilities 
of  the  project.  This  Is  the  last  phase  prior  to  full- 
scale  development,  and  deals  with  technology  that  has 
already  been  demonstrated  as  feasible  and  must  now  be 
Integrated  with  other  system  requirements.  Function 
performance  experiments  tend  to  be  expensive  and  time 
cons\iming. 

The  goal  of  promoting  project  development 
balance  will  be  achieved  by  maximizing  adherence  to  the 
guidelines  shown  in  Table  1. 


TABLE 

1 

BALANCED  TECHNOLOGY  PROGRAM 

Category 

Guidance 

FY  87 

Technology  base 

Concepts  and  designs 

Data  collection 

Function  performance 

35^ 

10^ 

50% 

28* 

57* 

III.  LITERATURE  REVIEW 


The  past  twenty  years  has  seen  a  great  deal  of 
analytic  activity  In  the  area  of  project  management, 
and  the  aspect  of  research  and  development  project 
funding  has  been  modelled  In  a  variety  of  ways.  It  is 
the  Intent  of  this  chapter  to  provide  a  current 
assessment  of  the  literature  addressed  to  quantitative 
models  of  research  and  development  project  funding. 
The  four  general  types  of  project  funding  models  that 
will  he  discussed  are  subjective  models,  risk 
assessment  models,  financial  models,  and  mathematical 
programming  models. 

A.  SUBJECTIVE  MODELS 

The  simplest  form  of  formal  R&D  project  evaluation 
Involves  subjective  models.  The  subjective  models  that 
are  used  the  most  frequently  are  checklist  and  scoring 
models.  Llberatore  and  Titus  [Ref.  4],  in  their  1985 
study  of  29  Fortune  500  firms,  found  that  almost  half 
of  the  29  firms  had  used  checklist  and  scoring  models 
to  help  manage  the  R&D  project  funding  process. 

The  checklist  involves  the  completion  of  a  profile 
chart  for  each  project  being  considered  for  funding. 
Criteria  are  listed  on  the  checklist  which  are  believed 
to  be  important  factors  in  determining  the  eventual 
success  or  failure  of  the  R&D  effort.  Each  candidate 
project  is  rated  according  to  a  subjective  scale  such 
as  yes/no  or  advantage/neutral/dlsadvantage .  The 
opinions  of  several  individuals  can  be  summarized  in  a 
checklist  by  averaging  their  opinions. 

Checklists  are  simple  and  easy  to  use  while  still 
providing  some  structure  to  the  decision  making 
process.  This  methodology  lends  itself  readily  to 
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types  of  Information  that  are  awkward  or  difficult  to 
include  in  more  formal  model  construction,  such  as 
social  Impacts  and  environmental  concerns.  Particular 
weaknesses  of  certain  projects  are  identified  quickly 
by  their  poor  ratings  on  certain  checklist  criteria. 
The  checklist  procedure  is  particularly  useful  in  time- 
constrained  decision  situations. 

While  the  ease  of  the  checklist  model  is  desirable, 
it  can  also  be  dangerous  since  critical  problems  may  be 
overlooked.  Complicated  relationships  are  not  easily 
Incorporated  into  such  a  model.  Although  many 
important  factors  may  be  Included  in  the  model ,  the 
relevance  or  weight  of  each  individual  factor  or 
project  is  not  captured. 

The  scoring  model  is  an  attempt  remedy  this  problem 
by  assigning  weights  to  individual  criteria  and 
summarizing  the  results  in  a  single  project  score. 
Decision  makers  are  required  to  state  their  preferences 
in  order  to  obtain  a  set  of  criteria  weights. 

Several  methods  have  been  developed  for  deriving 
these  weights.  These  Include  simple  rank-ordering  of 
the  criteria  and  various  types  of  paired  comparisons. 
Souder  [Ref.  5]  demonstrated  that  increasing  the  number 
of  scoring  Intervals  Improves  the  accuracy  of  the 
model.  However,  psychometric  testing  has  shown  that 
nine  is  the  maximum  number  of  Intervals  that  should  be 
used . 

In  1969,  Moore  and  Baker  [Ref.  6]  conducted  a  study 
comparing  scoring  models  with  more  sophisticated 
economic,  risk  analysis,  and  optimization  models,  and 
the  scoring  models  fared  well.  Using  standardized 
data,  the  scoring  models  they  tested  produced  results 
that  were  90  percent  rank  order  consistent  with 
economic  and  optimization  models.  The  analysis  was 


limited  to  only  five  criteria,  but  It  does  suggest  that 
a  scoring  model  can  be  a  useful  tool  when  the 
complexity  of  more  sophisticated  approaches  are  not 
Justified  on  the  basis  of  time  and  cost. 

Excellent  examples  of  scoring  model  applications  to 
R&D  project  funding  have  been  presented  by  Moore  and 
Baker  [Ref.  6],  Garglulo  and  Hannoch  [Ref.  7],  Motley 
and  Newton  [Ref.  8],  and  Dean  and  Nlshry  [Ref.  9]. 

The  major  disadvantage  with  the  scoring  model  Is 
that  it  Is  dimensionless,  thereby  limiting  Its  use  to 
rank  order  comparisons.  Such  comparisons  provide 
information  on  the  ordinal  scale,  when  often  times  R&D 
managers  desire  data  concerning  projects  on  a  ratio  or 
interval  scale.  Another  problem  Is  that  there  has  been 
little  analytic  activity  and  very  few  applications  of 
scoring  models  In  recent  years,  Indicative  that  other 
models  of  project  funding  are  now  more  preferable  than 
subjective  models. 

B.  RISK  ASSESSMENT  MODELS 

Many  civilian  firms  have  shown  a  proclivity  towards 
using  risk  assessment  techniques  to  make  project 
funding  decisions.  Llberatore  and  Titus  found  that  35K> 
of  the  respondents  In  their  study  were  familiar  with 
either  decision  tree  models  or  Monte  Carlo  simulation 
models,  the  two  risk  assessment  methods  that  are  the 
most  Important  and  applicable. 

Decision  tree  models  attempt  to  focus  on  the  fact 
that  many  R&D  activities  are  actually  a  series  of 
Interrelated  projects.  The  benefits  that  are  gained 
via  the  successful  completion  of  one  project  will 
affect  the  outcome  of  the  other  ventures.  Decision 
trees  have  been  used  extensively  to  help  in  the 
characterization  of  project  funding  decisions. 


The  procedure  is  to  establish  decision  points  or 
nodes  graphically  and  to  determine  branches  emanating 
to  and  from  each  node.  Each  branch  or  path  has  a 
certain  outcome  and  risk  associated  with  it.  For 
example,  consider  a  project  which  might  have  two 
different  funding  strategies.  If  given  strong  support, 
the  chances  that  the  project  might  produce  a  highly 
successful  outcome  might  be  .8,  and  the  chances  of  a 
moderate  success  are  .2.  However,  If  the  project  Is 
given  only  weak  support,  these  respective  probabilities 
of  high  and  moderate  success  might  change  to  .6  and  .4 
respectively.  The  decision  tree  model  is  built  by 
formalizing  all  such  outcomes  and  probabilities.  The 
optlm\im  path  Is  found  by  starting  at  the  right-hand 
side,  and  by  following  an  expected  value  algorithm, 
folding  back  to  the  starting  point.  At  each  node  the 
expected  value  Is  calculated  for  all  the  branches 
leaving  that  point,  and  the  path  with  the  highest 
expected  value  is  selected.  Projects  are  then 
interrelated  where  appropriate  and  an  entire  network  of 
decision  trees  are  connected  to  model  the  complete 
project  funding  process. 


This  method  Is  analytically  simple  and  can  be 
graphically  represented,  so  the  basic  logic  behind  the 
tree  structuie  can  be  easily  communicated  to  high-level 
managers.  It  has  been  demonstrated  as  very  useful  In 
making  decisions  concerning  projects  when  the  number  of 
projects  being  examined  for  funding  are  small  and  the 
Interrelationships  are  not  excessively  complex  [Ref. 
10]  . 

Ralffa  [Ref.  11]  and  Jackson  [Ref.  12]  have  both 
demonstrated  that  the  decision  tree  model  can  be 
successfully  applied  to  R&D  project  funding 
situations.  The  major  drawback  of  this  model  concerns 
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the  fact  that  outcomes  at  each  node  are  represented  by 
a  few  points  rather  than  a  continuous  distribution  of 
possible  outcomes.  Adding  more  branches  to  the  nodes 
provides  better  representation  of  the  underlying 
probability  distribution,  but  the  complexity  of  the 
calculations  involved  Increase  rapidly.  Any  user  of 
this  technique  must  be  willing  to  accept  the  tradeoffs 
between  accuracy  and  computational  difficulty/expense. 

The  Monte  Carlo  simulation  model  is  based  on  the 
decision  tree  model.  Each  of  the  nodes  is  replaced 
with  a  probability  distribution  and  this  produces  a 
stochastic  decision  tree:  This  is  analogous  to  adding 
an  arbitrarily  large  number  of  branches  to  each 
decision  point. 

The  Monte  Carlo  technique  generally  provides  a  more 
accurate  description  of  the  R&D  decision  process  and 
offers  a  better  basis  for  making  project  funding 
decisions  than  other  methods.  The  complexity  of  the 
projects  are  displayed  in  a  concise  manner  and  the 
stochastic  nature  of  the  uncertain  outcomes  of  R&D 
projects  are  recognized.  Hespos  and  Strassman  [Ref. 
13]  are  responsible  for  the  most  renowned  application 
of  Monte  Carlo  to  an  R&D  project  selection  and  fvmdlng 
scenario . 

The  cost  of  the  improvements  bought  by  the  Monte 
Carlo  model  is  that  there  is  a  dramatic  Increase  in 
information  requirements.  The  probability 
distributions  for  each  unknown  research  project  outcome 
must  be  estimated,  and  this  is  difficult  and  costly  in 
most  Instances. 

Perhaps  the  most  Important  methodological 
shortcoming  of  the  two  risk  assessment  models  presented 
here  is  that  neither  method  deals  with  resource 
constraints.  These  methods  assess  risk  probabilities 


but  fail  to  allocate  scarce  resources  among  research 
activities.  A  user  of  a  risk  assessment  model  would 
most  likely  be  someone  more  concerned  with  finding  the 
combination  of  projects  that  offer  the  highest  chance 
of  ultimate  R&D  success,  rather  than  optimizing  the  use 
of  funds  or  project  resources. 

C.  FINANCIAL  MODELS 

The  Liberatore  and  Titus  study  concluded  that 
financial  models  experience  heavy  use  and  have  a  high 
perceived  Impact  in  the  business  world  today,  as  625^  of 
the  firms  they  studied  reported  using  financial  project 
funding  techniques.  The  major  financial  modelling 
technique  used  in  the  project  funding  process  are 
Benefit  Cost  Ratio  models  (sometimes  called  Economic 
Index  models). 

Costs  and  benefits  associated  with  each  project  are 
assessed  in  terms  of  dollars  in  the  Benefit  Cost  Ratio 
model.  Costs  are  the  total  resource  costs  of 
supporting  the  research  project  or  group  of  projects, 
and  benefits  are  the  net  earnings  to  be  realized  from 
the  project  once  It  is  successful  (or  if  it  Is 
successful).  These  costs  and  benefits  are  expressed  as 
present  values  using  an  appropriate  discount  rate.  If 
the  ratio  of  benefits  over  costs  is  less  than  or  equal 
to  one,  there  Is  no  reason  to  undertake  the  R&D 
proj  ect . 

The  benefit  to  cost  ratio  can  be  easily  expanded  to 
include  probabilities  of  success  of  the  project  at 
various  stages  of  development.  Olsen  [Ref.  14]  used 
the  following  Benefit  Cost  Ratio  calculation  in  a 
project  funding  study: 
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In  equation  3-1,  V  represents  the  economic  value  of 
the  project,  s  Is  the  annual  sales  volume  derived  from 
the  project  if  the  project  succeeds,  and  p  is  the 
profit  per  unit.  The  product’s  expected  life  span  is 
represented  by  n,  and  r,  d,  and  m  are  the  probabilities 
of  research,  development,  and  marketing  success, 
respectively . 

The  ratio  in  equation  3-1  captures  the  risks 
Involved,  and  could  be  augmented  to  Include  noneconomic 
considerations.  Social,  environmental,  and  political 
costs  or  benefits  can  be  added  to  either  the  numerator 
or  denominator  of  the  ratio,  but  they  must  be  expressed 
in  dollar  units,  as  are  the  other  factors. 

Various  project  iterations  can  also  be  taken  into 
account  with  this  model.  For  example,  successful 
completion  of  a  project  may  result  in  a  product  which 
will  perform  the  same  function  as  an  already  existing 
project  or  another  one  under  development.  In  such  a 
case,  one  would  reduce  the  project  benefits  by  the 
expected  loss  in  earnings  from  sales  from  the  displaced 
product . 

Benefit  cost  ratio  models  e  desirable  in  many 
situations  since  they  overcome  tbe  dimensionality 
problems  of  scoring  models  and  checklist  models. 
Decision  makers  are  required  to  clearly  quantify  their 
evaluation  of  a  project.  The  favorable  result  is  that 
difficult  Issues  cannot  be  avoided  through  the  use  of 
arbitrary  scales,  as  the  benefit  cost  ratio  has  an 
absolute  interpretation.  This  allows  project  rejection 
decisions  that  do  not  involve  unnecessary  comparisons 
with  other  projects. 

Gearing  and  Adams  [Ref.  15]  and  Souder  [Ref.  16] 
explain  how  the  benefit  cost  ratio  model  might  be 
applied  to  an  R&D  project  funding  model.  Keefer  [Ref. 


17]  and  Costello  [Ref.  18]  are  more  recent  proponents 
of  the  benefit  cost  model. 

One  problem  with  this  type  of  financial  model  is 
that  the  Information  required  is  often  times  very 
difficult  to  obtain.  The  probabilities  and  cost  and 
benefit  estimations  usually  require  a  considerable 
degree  of  experience  on  the  part  of  the  analyst  and/or 
historical  precedent.  It  is  also  difficult  to  express 
many  noneconomic  effects  in  dollar  terms,  especially  in 
military  project  funding  efforts. 

Another  shortcoming  with  the  benefit  cost  R&D 
project  selection  and  funding  technique  is  that  benefit 
cost  ratios  are  not  useful  when  evaluating  the 
consequences  of  alternative  funding  levels.  Each 
element  in  the  ratio  must  be  reassessed  if  the  funding 
level  is  increased  or  reduced.  As  with  risk  assessment 
models,  benefit  cost  models  do  not  recognize  resource 
constraints.  There  is  no  way  of  quantitatively 
limiting  a  particular  resource  at  a  certain  amount,  or 
forcing  the  model  to  perform  to  a  specific  level. 

D.  MATHEMATICAL  PROGRAMMING  MODELS 

Mathematical  programming  models  have  been  used 
extensively  during  the  last  quarter  of  a  century  to 
solve  many  allocation  and  capital  budgeting  problems. 
Surprisingly,  the  Liberatore  and  Titus  study  found  that 
there  was  no  usage  of  mathematical  programming  for  R&D 
project  funding  in  the  firms  that  they  investigated. 
However,  that  fact  has  not  precluded  many  optimization 
proponents  researching  new  project  selection  and 
funding  models.  The  branches  of  math  programming  that 
have  seen  the  most  activity  in  this  area  are  linear 
programming,  nonlinear  programming.  Integer 
programming,  and  goal  programming. 


The  technique  of  linear  programming  Is  a  well  known 
and  useful  one.  Project  fxindlng  models  such  as  those 
proposed  by  Asher  [Ref.  19]  and  Hanssman  [Ref.  20]  are 
formulated  In  the  general  form  shown  below: 

maximize  51  (3-2) 
subject  to  ^  AX  <-  B  (3-3) 

0  <-  X  <-  1  (3-4) 

X  Is  an  n-component  vector  representing  the  funding 
levels  of  the  projects,  C  Is  an  n-component  vector 
representing  the  contribution  of  the  various  projects, 
B  Is  an  m-component  vector  representing  resource 
levels,  and  A  Is  an  m  x  n  matrix  representing  resource 
usages  of  the  projects. 

The  primary  advantage  of  linear  programming,  and 
all  mathematical  programming  models  for  project 
funding.  Is  that  modelled  situations  can  be  forced  to 
meet  resource  constraints  as  the  program  seeks  to 
maximize  the  objective  function. 

The  linear  programming  formulation  shown  above 
allows  the  project  to  be  funded  at  a  maxlmvim  level  when 
X  -  1 ,  or  any  level  down  to  X  -  0 ,  where  the  project  Is 
not  being  funded.  Of  course,  this  model  requires  that 
a  linear  assumption  be  made  concerning  the  resource 
constraints;  the  changes  In  X  motivated  by  changes  in  B 
are  assumed  to  be  constant. 

In  many  situations  projects  are  either  selected  for 
development  and  full  funding,  or  they  are  not  selected 
at  all.  Many  authors  have  proposed  Integer  programming 
formulations  In  which  the  X’s  can  only  take  on  values 
of  zero  or  one.  Wlengartner  [Ref.  21]  was  the  first  to 
propose  the  following  formulation  of  Integer 
programming  project  funding  models; 


Find  X  -  X 


•  •  •  •  ^ 


Xq  so  as  to  maximize 


(3-5  ) 


1'  ^2' 

ERj  Xj 


subject  to: 
where : 

- 

- 

Aij  - 
Bi  - 


^^IJ  Bi  -  1,  ...  m  (3-6) 

1  If  the  program  Is  selected 

0  Is  the  program  Is  not  selected 

return  of  program  J 

budget  consumed  In  year  1  by  project  J 
amount  of  total  budget  available  for  year 


1 


1 


The  above  formulation  allows  the  decision  maker  to 
select  a  subset  of  projects  from  among  a  given,  finite 
set.  The  objective  Is  to  maximize  the  return  or 
benefit  from  these  programs  while  continuing  to  satisfy 
budget  limitations  or  any  other  resource  constraints. 
The  end  result  In  this  Instance  Is  that  the  decision 
maker  will  be  provided  the  list  of  projects  that  he  can 
support  at  the  fully  funded  level,  given  the 
constraints  that  have  been  placed  In  the  program. 

While  many  functional  relationships  In  a 
mathematical  model  of  the  project  funding  process  may 
be  linear  In  nature,  others  are  more  realistically 
described  by  nonlinear  relationships.  Numerous 
researchers  began  work  on  a  project  funding  model 
thinking  that  a  constant  change  of  one  variable  In 
response  to  another  was  appropriate,  only  to  discover 
that  such  an  assumption  was  false. 

Nonlinear  programming  models  are  very  similar  In 
structure  to  linear  models;,  the  only  difference  Is  that 
the  constraint  equations,  objective  function,  or  both 
are  nonlinear.  If  the  model  builder  has  enough  data  to 
support  nonlinear  equations  then  there  Is  no  reason  to 
make  the  standard  linear  assximptlon  that  the  vast 
majority  of  project  selection  and  funding  models  make. 


An  excellent  example  of  a  nonlinear  approach  was  made 
by  Taylor,  Moore,  and  Clayton  [Ref.  22].  They 
identified  over  twenty  nonlinear  relationships  for 
inclusion  in  their  model.  For  Instance,  they  were  able 
to  state  that  the  probability  of  success  of  a 
particular  project  increased  according  to  the  amount  of 
money  that  was  spent  on  it,  but  at  a  decreasing  (rather 
than  a  constant)  rate.  A  perfectly  acceptable 
methodology  is  to  initially  make  the  model  linear  and 
make  applicable  nonlinear  modifications  as  more 
information  becomes  available. 

Linear,  integer,  and  nonlinear  project  funding 
models  all  have  weaknesses.  Linear  models  are  too 
simplistic  for  some  project  selection  situations. 
Since  resource  utilization  as  well  as  the  project 
funding  level  can  be  used  as  decision  variables,  a 
strictly  0-1  Integer  program  can  be  overly  restrictive. 
Nonlinear  programs  usually  require  considerably  more 
information  and  research  than  linear  models. 

The  most  serious  shortcoming  of  these  mathematical 
models  is  that  they  are  restricted  to  the  consideration 
of  only  a  single  objective  function.  In  most  real- 
world  situations,  however,  there  are  usually  several 
objectives  that  are  desirable  to  the  decision  maker. 
In  1961  Charnes  and  Cooper  [Ref.  23]  Introduced  the 
concept  of  goal  programming  as  an  attempt  to  rectify 
this  problem. 

Goal  programming  is  a  modification  of  linear 
programming  that  allows  multiple  goals  or  objectives  to 
be  optimized  in  the  model.  The  decision  maker  is 
required  to  rank  in  an  ordinal  manner  the  goals 
established  for  the  organization.  In  a  linear  program 
a  single  criterion  is  optimized  directly,  whereas  in 


goal  programming  the  deviations  from  the  exact 
satisfaction  of  the  goals  are  minimized. 

The  formulation  can  be  expressed  as  follows: 


Minimize : 

Ld"  +  d+ 

(3-7) 

Subject  to 

:  ]^Gx  +  d“  -  d"*"  -  g 

(3-8) 

53  Ax  <-  b 

(3-9) 

d“ ,  d"*",  X  >-  0 

(3-10) 

variables 

shown  In  equation  3-7, 

d“  and 

represent  the  negative  and  positive  deviations  from  the 
goal  constraints  to  be  achieved  (equation  3-8).  These 
deviations  are  also  referred  to  In  goal  programming 
literature  as  underachievement  and  overachievement 
variables.  Equations  3-9  and  3-10  are  typical  linear 
programming  constraints  regarding  resource  availability 
and  non-negatlvlty .  Note  that  equation  3-8  is  not  an 
inequality  constraint  but,  contrary  to  most 
mathematical  programming  techniques,  is  an  absolute 
equality  statement.  This  Is  intended  to  place  the 
deviations  from  the  goal  constraints  Into  the  deviation 
variables . 

The  goal  programming  project  fiindlng  model  has 
proven  to  be  very  flexible  and  popular.  The  basic 
methodology  can  be  modified  to  Include  nonlinear  and 
integer  constraints.  Charnes  and  Stedry  [Ref.  24] 
wrote  a  linear  goal  programming  model  that  broke  the 
project  selection  process  into  short  run  and  long  run 
funding  strategies.  Salvia  and  Ludwig  [Ref.  25] 
modelled  the  project  funding  process  at  the  Lord 
Corporation  using  a  goal  program  that  optimized  the 
attainment  of  ten  goals  Involving  25  projects.  Ignlzlo 
[Ref.  26]  created  an  Integer  goal  programming  project 
funding  model  for  the  US  Army  Ballistic  Missile  Defense 
Agency,  and  a  general  Integer  model  was  written  by 


wlnkofsky.  Baker,  and  Sweeney  In  1981  [Ref.  27]. 
Nonlinear  programming  was  recently  added  to  the  list  of 
successful  modifications  to  the  general  goal 
programming  algorithm  when  Taylor,  Moore,  and  Clayton 
published  their  Integer  nonlinear  goal  program  project 
funding  model  [Ref  22]. 

E.  PREFERRED  MODEL 

In  this  chapter  the  four  major  model  types  for 
project  funding  have  been  discussed:  subjective 
models,  risk  assessment  models,  financial  models,  and 
mathematical  models.  Though  each  model  type  Is 
Important  and  useful  In  many  situations,  the  goal 
programming  model  for  project  funding  in  the 
mathematical  model  category  Is  the  most  applicable  to 
the  project  selection  and  funding  scenario  for  the  US 
Army  Strategic  Defense  Command.  This  Is  true  for 
several  reasons.  First,  the  goal  programming  algorithm 
allows  the  use  of  resource  constraints,  a  very  critical 
feature  since  the  SDC  Is  concerned  with  limited  funding 
resources.  Second,  goal  programming  permits  the 
decision  maker  to  specify  multiple  objectives  or 
targets  to  be  achieved;  as  discussed  In  the  previous 
chapter,  there  are  several  goals  at  Issue  here. 
Finally,  In  the  last  decade  goal  programming  appears  to 
have  been  established  as  the  preferred  method  of 
solving  the  project  funding  problem.  N\imerous 
applications  of  goal  programming  have  been  made  to 
scenarios  not  too  dissimilar  to  the  one  facing  the  SDC; 
the  articles  written  by  other  goal  programmers  will 
undoubtedly  assist  project  selection  efforts  In  this 
endeavor . 

For  the  reasons  Just  stated,  goal  programming  will 
be  the  principle  tool  used  In  the  project  funding  model 
to  be  discussed  In  the  remainder  of  this  thesis. 


IV.  MODEL  DEVELOPMENT 


The  goal  programming  technique  requires  the 
development  of  mathematical  equations  to  represent 
model  goals  and  constraints.  In  the  second  chapter  the 
four  major  project  funding  goals  for  the  USASDC  were 
Introduced.  These  goals  are  reviewed  below: 

1.  Maximize  military  effectiveness 

2.  Minimize  project  development  risk 

3.  Minimize  project  development  time 

4.  Maximize  project  development  balance 

It  Is  the  Intent  of  this  chapter  to  determine  a 
methodology  for  converting  subjective  Judgments  of 
individual  project  contributions  to  the  major  SDI 
project  goals  Into  coefficient  weights.  These  weights 
will  represent  the  performance  of  each  project 
regarding  each  goal  or  constraint  equation  in  the  GP 
model  formulation. 

A.  TRADITIONAL  METHODS  OF  QUANTIFYING  SUBJECTIVE 

JUDGMENTS 

A  key  problem  in  the  project  f\uidlng  modelling 
process  Involves  the  quantification  of  subjective  terms 
such  as  effectiveness,  risk,  time,  and  balance.  The 
JSASDC  does  not  have  a  table  or  docviment  that  lists 
values  of  funded  projects  In  such  broad  terms.  The  WPD 
for  each  project  lists  funding  authorizations  and 
milestone  objectives,  but  It  does  not  Include  a  score 
for  effectiveness,  risk,  time  or  balance.  Project 
selection  and  funding  decisions  are  largely  based  on 
the  subjective  opinions  of  key  personnel  Involved  with 
each  project,  especially  the  program  element  managers 
assigned  to  the  USASDC  headquarters.  Operations 
research  literature  contains  several  traditional 


methods  for  quantifying  Intangibles,  a  task  that  must 
be  performed  so  that  coefficient  weights  for  the  GP 
model  can  determined. 

1 .  Numerical  Rating  Method 

A  very  simple  method  for  quantifying 
subjective  Judgments  is  the  ntimerlcal  rating  method 
(sometimes  called  the  magnitude  estimation  method). 
This  method  was  first  proposed  by  Stevens  [Ref.  28]  as 
a  method  of  eliciting  comparative  rankings  in 
psychophysical  experiments.  Judges  are  given  two 
reference  points  and  asked  to  associate  the  rated  items 
with  these  points.  This  can  be  done  either  by  using 
numbers,  or  by  plotting  points  on  a  continuous  number 
line.  When  using  two  reference  points,  one  can  imply  a 
constant  Interval  scale.  i^or  example.  In  a  project 
funding  scenario,  a  program  element  manager  might  be 
asked  to  rate  the  potential  technological  payoff  of  two 
projects.  The  manager  could  perform  this  task  by 
indicating  where  these  projects  fall  on  a  continuous 
line,  referenced  by  a  prepositioned  project  with  low 
payoff  and  another  with  high  payoff,  as  demonstrated 
below  in  Figure  1. 


- X - X - X - X - 

/S  /\ 

low  payoff  proj  1  high  payoff  proj  2 

proj  ec t 

Figure  1  -  Numerical  Rating  Continuous  Line 


The  researcher  could  then  use  these  Intervals 
to  determine  the  scale  relationship  of  these  four 
projects.  Since  this  results  in  Interval  scale  data, 
the  points  can  then  be  linearly  transformed  to  any 


other  scale  desired;  a  common  scale  would  be  the  0-100 
scale . 


The  primary  advantage  of  this  method  Is 
computational  simplicity.  Basic  statistical  work  can 
be  performed  on  the  results,  and  one  can  easily  test 
for  significant  differences.  Unfortunately,  problems 
often  arise  when  determining  the  reference  points; 
there  Is  no  natural  origin  and  Judges  frequently 
disagree  with  the  reference  point  positioning.  Many 
researchers  also  have  difficulty  with  the  lack  of 
bounds  on  the  Interval  scale. 

2 .  Categorical  Judgement  Method 

A  commonly  used  means  of  obtaining  numerical 
results  from  subjective  ratings  is  the  categorical 
Judgement  method,  wherein  Judges  assign  Instances  to 
ranked  categories.  For  example,  pollsters  often  ask 
people  to  rate  political  candidates  as  poor,  fair, 
average,  good,  or  outstanding.  Program  managers  could 
similarly  be  asked  to  rate  project  milestone  risk 
according  to  a  scale  of  very  low,  low,  average,  high, 
or  very  high.  Dyer,  Mathews,  Wright,  and  Yudowltch 
[Ref.  29]  recommend  that  five  categories  be  used  for 
this  technique. 

The  procedure  begins  by  rating  the  Items  In 
question  and  then  arranging  the  cvunulatlve  frequency 
data  In  a  matrix  of  n  row  Instances  and  m  column 
categories.  The  elements  of  this  matrix  are  treated  as 
areas  under  a  standard  normal  curve  and  are  converted 
to  the  corresponding  Z  values.  These  values  are  then 
recorded  In  a  matrix  consisting  of  n  rows  and  m-1 
coliimns,  since  the  last  coltunn  may  be  omitted  for 
computational  purposes.  The  row  and  col  inn  averages 
are  computed,  and  called  Rj^  and  Cj  respectively,  and 


the  grand  mean,  G,  Is  calculated.  A  row  sum-of-squares 
term  is  computed  as  shown  below: 

SSC  -  Ej  (Cj  -  G)2  (4-1) 

For  each  row,  the  following  is  computed: 

SSRi  -  El  (Zij  -  Ri)2  (4-2) 

The  scale  values  of  the  Instances,  Si,  are 
found  by  solving  the  following  equation  for  each  row: 

Si  -  G  -  Zi  “  SORT  (SSC/SSRi)  (4-3) 


In  equation  4-3,  S  represents  the  interval 
scale  value,  G  is  the  grand  mean  of  the  Z  matrix,  SORT 
represents  the  square  root  mathematical  operation,  and 
SSC  and  SSR  are  the  colximn  and  row  sum-of-squares. 

The  categorical  Judgment  method  succeeds  in 
obtaining  an  Interval  scale  value  that  can  be  linearly 
transformed  to  any  other  scale.  It  Is  more 
sophisticated  than  the  ntunerlcal  rating  method,  but 
still  computationally  easy.  Questionnaires  employing 
this  technique  are  straightforward  and  tmcompi Icated . 
The  major  drawback  with  the  categorical  method  concerns 
the  five-category  limitation;  this  Is  not  accurate 
enough  for  most  serious  efforts  to  quantify  subjective 
evaluations . 

3 .  Least  Squares  Method 

A  frequent  procedure  for  eliciting  expert 
opinion  la  that  of  asking  Judges  to  do  some  form  of 
ordinal  ranking  of  various  instances  of  a  designated 
property.  The  Least  Squares  Method  was  first  proposed 
by  Guilford  [Ref.  30]  as  a  means  of  obtaining  scaled 
Interval  data  from  ordinal  Judgments.  The  procedure 
has  proven  very  useful  and  relatively  simple. 
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The  method  Is  Initiated  by  soliciting  the 
ordinal  responses  of  the  Judges  comparing  several  items 
on  the  basis  of  a  particular  factor  or  quality.  For 
example,  Judges  might  be  asked  to  rate  several 
television  shows  as  excellent,  good,  fair,  or  poor. 
Suppose  that  a  Judge  feels  program  B  is  better  than 
program  C,  which  is  better  than  program  A.  Tallies  in 
the  fj^j  matrix  would  be  made  as  shown  in  Table  2. 
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Note  that  the  cross-diagonal  elements  each  sum 
to  the  total  nvimber  of  Judges;  for  this  example  there 
were  100.  The  next  step  Is  to  convert  the  matrix 

to  a  probability  matrix,  Pjj .  This  Is  done  according 
to  the  equation  shown  below. 

PlJ  “  ^IJ  /  <^1J  +  fjl)  (4-4) 

To  continue  with  the  example,  the  probability 
matrix  In  Table  4  was  obtained. 


It  Is  Important  to  note  that  the  diagonal 
constituents  of  this  matrix  are  set  equal  to  .5  and 
values  In  each  column  are  added  to  obtain  column  stuns. 
Probability  matrix  entries  greater  than  .98  and  less 
than  .02  are  omitted  In  order  to  avoid  numerical  bias. 
The  p^j  matrix  Is  then  converted  to  a  matrix  of 
standard  normal  values.  In  our  example,  the  Zj^j  matrix 
Is  shown  In  Table  5. 

The  sought-after  scale  values  are  equal  to  the 
coltunn  stuns  of  the  Zj^j  matrix.  As  In  the  categorical 
Judgment  method,  these  scale  values  are  linearly 
transformable.  The  least  square  procedure  has  the 
advantage  of  requiring  a  relatively  low  level  of 
ordinal  assessments,  so  data  collection  surveys  are 
simple.  Judges  are  not  asked  to  make  lengthy  pairwise 
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TABLE  5 

LEAST  SQUARE  METHOD  STANDARD  NORMAL  MATRIX 


.  583 
0 

.385 


-  .  100 
.385 
0 


Svims 


-.198 


.285 


comrarisons ;  rather,  they  simply  list  the  instances  in 
what  they  believe  is  the  correct  order  of  importance 
regarding  the  compared  factor.  This  method  is  not 
appropriate  for  use  in  the  project  funding  model  being 
developed  here,  however,  because  it  requires  a  large 
number  of  Judges.  Many  expert  opinions  must  be 
collected  gathered  in  order  to  make  a  probability 
matrix  as  described  above.  In  the  USASDC  there  are  at 
most  three  experts  In  each  program  element  management 
shop,  and  this  is  not  sufficient  to  employ  this  method 
ef f ect i vely . 

4.  Constant  Sum  Method 


The  Constant  Sum  Method  is  a  technique 
developed  by  Comrey  in  1950  [Ref.  31]  that  quantifies 
subjective  ratings  based  on  pairwise  comparisons. 
Judges  are  asked  to  consider  each  possible  pair  of 
instances,  and  within  each  pair,  split  100  points. 
Thus,  for  each  Judge  with  n  Instances  to  be  scaled, 
n(n-l)/2  pairs  must  be  considered  and  100  points 
divided  between  each.  The  largest  number  is  given  to 
the  member  of  the  pair  having  the  greatest  amount  of 
the  property  being  considered.  The  computational 
procedure  begins  by  creating  a  comparison  matrix,  with 
the  cross  diagonal  elements  summing  to  100  points. 
This  matrix  is  then  averaged,  depending  on  the  number 


Sum  Method 


of  Judges,  and  a  W  matrix  Is  obtained  by  dividing  each 
element  by  its  respective  cross-diagonal  element.  The 
column  products  are  multiplied  by  the  nth  root,  where  n 
is  the  number  of  compared  items.  These  values  equal 
the  desired  scale  quantities. 

An  example  sheds  further  light  on  this  method. 
Consider  two  Judges  evaluating  three  cheeses  on  the 
basis  of  taste.  Their  respective  comparison  matrices 
are  shown  in  Table  6. 


TABLE  6 

CONSTANT  SUM  METHOD  COMPARISON  MATRICES 


!il.J 

Judge 

1  A. 

1 

B 

C 

Judge 

1  A 

2 

B 

C 

A 

50 

20 

40 

A 

50 

1  0 

30 

B 

80 

50 

60 

B 

90 

50 

70 

C 

60 

40 

50 

C 

70 

30 

50 

In  both  instances  above,  the  Judges  indicate 
that  each  prefers  cheese  A  to  B,  cheese  A  to  C,  and 
cheese  C  to  B ,  but  strength  of  these  endorsements  are 
different.  The  next  step  is  to  combine  both  matrices 
by  averaging  the  values  as  shown  in  Table  7. 


TABLE  7 

CONSTANT  SUM  METHOD  AVERAGE  COMPARISON  MATRIX 


The  matrix  is  then  computed  using  equation 

4-5  shown  below: 

'^IJ  -  aij  /  aji  (4-5) 

The  matrix  for  this  example  is  shown  in 

Table  8. 


TABLE  8 

CONSTANT  SUM  METHOD  W  MATRIX 


WiJ  1 

1  A 

B 

C 

A 

1.00 

.72 

.  54 

B 

5.67 

1 . 00 

1.86 

C 

1.86 

.  54 

1 . 00 

The  scale  values  can  be  solved  for  now  by 
taking  each  colximn  product  to  its  respective  nth  root. 
In  our  example,  n,  the  nximber  of  cheeses  being 
compared,  is  3.  The  calculation  is  demonstrated  in 
Table  9, 


TABLE  9 

CONSTANT  SUM  METHOD  SCALE  VALUE  COMPUTATION 

51  -  [(1 )(5.67)(1.86)]1/3  -  2.19 

52  -  [( .72  )(1  )( .54  )]l/3  -  .73 

53  -  [( .54)(1.86)(1)]1/3  -  1.00 


A  great  advantage  of  this  method  over  the 
others  that  have  been  discussed  is  that  it  provides 
quantitative  values  that  are  all  on  a  similar  ratio 
scale,  rather  than  the  interval  scale.  Ratio  scales 


allow  not  only  linear  transformations.  but  all 


arithmetic  operations.  For  example,  one  can  conclude 
that  an  Instance  with  a  value  of  1.0  has  twice  the 
compared  property  of  an  Instance  with  a  .5  value.  A 
problem  with  this  method  Involves  consistency;  Judges 
often  contradict  themselves  (unintentionally), 
especially  when  the  number  of  comparisons  is  large. 
Many  Judges  find  categorical  comparisons  much  easier  to 
make  than  numerical  ones. 

The  traditional  methods  of  quantifying 
subjective  evaluations  are  not  adequate  for  a  project 
funding  model.  A  method  Is  needed  that  does  not  suffer 
from  any  of  the  major  disadvantages  prevalent  In  the 
procedures  Just  discussed.  In  1978  Saaty  [Ref.  32] 
developed  a  method  of  quantifying  subjective 
intangibles  that  is  far  superior  to  any  of  the 
traditional  methods  Just  described.  He  called  this 
procedure  the  Analytic  Hierarchy  Process,  and  It  will 
be  the  subject  of  the  remainder  of  this  chapter. 

B.  THE  ANALYTIC  HIERARCHY  PROCESS  (AHP) 

In  less  than  a  decade,  the  AHP  has  found  Its  way 
Into  many  Important  declslon-maklng  models.  Our 
Investigation  of  the  AHP  will  begin  with  a  detailed 
discussion  of  the  four-step  AHP  procedure  that  has  been 
popularized  by  Saaty.  These  four  critical  steps  in 
converting  subjective  Judgments  Into  numerical  results 
are  shown  In  Figure  2. 

Step  1  Involves  hierarchic  decomposition.  The 
researcher  must  develop  a  logical  representation  of  the 
factors  and  levels  Involved  In  problem  scenario.  For 
example,  consider  a  person  desiring  to  purchase  a  new 
automobile.  The  objective  of  buying  a  car  Is  placed  at 
the  top  of  the  hierarchy.  Factors  that  Influence  the 
decision,  such  as  price,  comfort,  and  status  are  placed 
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Figure  2  -  AHP  Procedure 


In  the  next  hierarchy  level,  and  the  various  car 
alternatives  are  listed  at  level  3  of  Figure  3. 

In  step  2,  Judges  are  asked  to  make  pairwise 
comparisons  of  the  factors  at  each  level  using  the 


pairwise  comparison  scale  shown  In  Table  10.  This 
table  Is  the  result  of  extensive  psychological 
measurement  studies.  Saaty  concluded  that  human 
sensory  perception  Is  capable  of  distinguishing  only 
nine  distinct  subjective  performance  levels.  As  in  the 
constant  sum  method,  N(N-l)/2  pairwise  comparisons  must 
be  made,  and  the  results  are  placed  in  a  comparison 
matrix.  In  the  car  buying  example,  a  matrix  like 
theone  shown  in  Table  11  could  be  obtained. 

In  step  3,  the  eigenvalue  solution  technique  Is 
employed.  As  shown  by  Saaty  and  Vargas  [Ref.  45],  the 
procedure  Involves  solving  for  the  largest  eigenvalue. 
Lambda  Max.  In  the  example  we  are  concerned  with. 


TABLE  10 


AHP  PAIKWISE  COMPARISON  SCALE 


Intensity 
of  Importance 


Definition 


1 

3 

5 


Equal  contribution  by  both 
factors/alternatives  to  the  property 

One  factor  contributes  slightly  more 
to  the  property  than  the  other 

One  factor  is  strongly  favored  over 
the  other 


7 


One  factor  is  very  strongly  favored 
over  the  other 


9  The  evidence  favoring  one  factor  over 

the  other  is  of  the  highest  possible 
order  of  affirmation 


2, 4, 6, 8  Intermediate  values 

Reciprocals  If  activity  1  has  one  of  the  above 

niimbers  assigned  to  it  when  compared 
to  activity  J,  then  J  has  the 
reciprocal  value  when  compared  to  i 


TABLE  11 

AHP  EXAMPLE  COMPARISON  MATRIX 


Comfort 

Ford 

Chevy 

BMW 

Ford 

1 

1/2 

1/4 

Chevy 

2 

1 

1/2 

BMW 

4 

2 

1 

Lambda  Max  was  found  to  be  3.0.  The  normalized 
eigenvector  is  then  computed  and  is  as  shown  in  Table 
12  . 

The  AHP  interprets  the  eigenvector  as  clear 
evidence  that  the  BMW  will  contribute  the  most  to  your 
comfort  while  operating  a  car,  since  the  BMW  comfort 
factor  is  twice  the  size  of  the  Chevy  comfort  factor, 
and  three  times  as  large  as  the  Ford  value. 
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TABLE 

12 

AHP 

EXAMPLE 

EIGENVECTOR 

Comfort 

Ford 

Chevy 

BMW 

Ford 

Chevy 

BMW 

1 

2 

4 

1^2 

2 

EIGENVECTOR:  .143 

.286 

.571 

Ford  comfort  value: 
Chevy  comfort  value 
BMW  comfort  value: 

.  143 
:  .286 
.571 

In  the  simple  example  Just  described,  it  was 
apparent  that  the  responses  of  the  Judges  were  not 
contradictory  or  conflicting.  However,  in  many 
Instances  the  ntimber  and  complexity  of  subjective 
Judgments  Involved  In  the  AHP  make  It  necessary  to 
compute  a  consistency  ratio  (CR).  It  Is  fortunate  that 
the  AHP  provides  a  method  for  computing  the  CR ,  for 
this  affords  the  user  the  opportunity  to  evaluate  the 
quality  of  the  data  that  has  been  Input  In  the 
comparison  matrices.  Respondents,  despite  their  best 
efforts  to  the  contrary,  are  often  Inconsistent  and 
Intransitive  In  making  pairwise  comparisons. 

The  calculation  of  a  consistency  ratio  ( CR )  can  be 
demonstrating  by  continuing  with  our  car  buying 
example.  Suppose  a  Judge  felt  the  Ford  was  more 
comfortable  than  the  Chevy,  and  the  Chevy  more 
comfortable  than  the  BMW.  The  Judge  would  be 
Inconsistent  If  he  rated  the  BMW  more  comfortable  than 
the  Ford;  such  a  response  would  stimulate  a  high  CR. 
The  CR  is  found  by  first  finding  the  consistency  Index 
(Cl).  The  consistency  Index  (Cl)  Is  determined  using 
equation  4-3,  where  N  Is  the  number  of  Items  being 
compared . 


Cl  - 


Lambda  Max  -  N 

n”-~I 


(4-3) 


The  Cl  Is  compared  to  the  corresponding  random 
consistency  Index  (RI)  shown  in  Table  13.  The  RI  are 
average  consistency  indices  for  matrices  whose 
reciprocal  entries  were  drawn  at  random  from  the  values 
1/9,  1/8 . 1.  2 . 8  ,  9. 


TABLE  13 

RANDOM  CONSISTENCY  INDEX 


RI|  0  0  .58  .9  1.12  1.24  1.32  1.41  1.45  1.49 


The  consistency  ratio  can  then  be  found,  since  CR 
Is  equal  to  the  ratio  CI/RI.  The  value  of  CR  should  be 
10  percent  or  less.  If  It  Is  more  than  10  percent,  the 
Judgments  are  considered  Inconsistent;  the  problem 
should  be  studied  again  and  the  comparison  matrix 
revised . 

Step  4  aggregates  relative  weights  of  various 
levels  obtained  from  the  third  step  In  order  to  produce 
a  vector  of  composite  weights.  This  vector  constitutes 
the  scaled  rankings  of  the  various  alternatives  with 
respect  to  the  factor  being  studied.  The  procedure  is 
to  start  at  the  highest  level  hierarchy  and  determine 
the  weights  of  the  factors  at  that  level.  These 
weights  are  then  multiplied  by  the  eigenvector  at  the 
next  level,  and  new  vectors  are  obtained.  This  process 
continues  until  the  last  level. 

To  continue  with  our  car  example.  In  this  step  the 
eigenvectors  of  price,  comfort,  and  status  would  be 
combined.  Suppose  the  buyer  felt  price  was  the  most 
Important  factor,  followed  by  status  and  then  comfort. 


'il*' 

•Si' 


This  would  then  be  placed  In  a  comparison  matrix  and  an 
eigenvector  determined.  The  procedure  Involved  In  step 
4  Is  demonstrated  In  Table  14. 


TABLE  14 

CAR  BUYING  EXAMPLE  STEP  4  DEMONSTRATION 


Level  2  eigenvalues:  Price  -.5 

Comfort  -.2 
Status  -.3 


Level  3  eigenvalues: 


Factor  | 

Ford 

Chevy 

BMW 

Price 

.4 

.4 

.2 

Comf  or t 

.2 

.3 

.  5 

Status 

.2 

.  1 

.7 

Ford  weight  - 
Chevy  weight  - 
BMW  weight 


.4 )  +  ( .2  H -2 )  +  ( .3)( .2  - 

.4)  +  (  ,2)1 .3)  +  (  .3)1,  .1)  - 
.2  +(  .2  (  .5  +  .3  I.  .7  - 


Step  4  Informs  us  that  on  the  basis  of  the  data  In 
this  example  concerning  the  buyers  vehicle  preferences 
regarding  price,  comfort,  and  status,  the  BMW  should  be 
purchased.  The  Ford  and  Chevy  are  rated  too  closely  to 
distinguish  between  them. 

The  AHP  affords  several  advantages  over  the 
traditional  methods  discussed  earlier  In  this  chapter. 
Use  of  the  AHP  allows  the  researcher  to  quantify 
weights  at  more  than  Just  one  hierarchy  level.  The  AHP 
gives  scaled  values  that  are  on  a  ratio  scale,  and  the 
AHP  Is  the  only  method  that  provides  a  mechanism  for 
checking  on  the  consistency  of  the  Input  data.  The  AHP 
Is  more  accurate  than  the  traditional  methods,  since  It 
has  Its  roots  In  psychological  testing  and  hximan 
sensory  perception  capabilities.  The  only  disadvantage 
of  this  method  Is  that  It  Is  considerably  more  complex. 
However,  the  benefits  gained  from  using  the  AHP  far 
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exceed  this  drawback,  since  a  computer  program  can  be 
written  to  overcome  computational  difficulty. 

The  choice  of  AHP  to  quantify  subjective 
evaluations  has  become  quite  common  during  the  last 
five  years.  The  areas  in  which  the  AHP  has  been 
applied  are  diverse  and  numerous.  In  a  1984  book 
review.  Gray  [Ref.  33]  noted  that  "...you  have  to 
actually  try  the  method  In  some  simple  situations  to 
understand  its  remarkable  power".  Zahedl  recently 
[Ref.  34]  surveyed  the  AHP  and  over  fifty  published 
applications  of  AHP  in  twenty-seven  topic  areas.  These 
Instances  Included  the  project  funding  model  developed 
by  Johnston  and  Hlhn  [Ref.  35],  and  the  budget 
allocation  models  of  Slnuany-Stern  [Ref.  36]  and  Arbel 
[Ref.  37]. 

The  AHP  Is  superior  to  the  traditional  methods  of 
quantifying  subjective  evaluations  discussed  in  this 
chapter,  and  It  has  been  successfully  applied  to 
similar  projects.  These  two  facts  lead  to  the 
conclusion  that  the  AHP  Is  the  preferred  technique  to 
use  in  deriving  the  coefficient  weights  for  the  linear 
equations  In  the  GP  model  being  developed. 


V .  GOAL  PROGRAM  FORMULATION 


In  this  chapter,  mathematical  expressions  of  the 
goals  and  constraints  for  the  GP  model  will  be 
developed.  Discussions  of  model  constituents  such  as 
the  decision  variables,  system  constraints,  goal 
constraints,  and  the  achievement  function,  will  be 
Included  in  order  to  formulate  the  GP  model. 

A.  DECISION  VARIABLES 

The  first  step  in  the  construction  of  a 
mathematical  decision  model  is  the  determination  of  the 
decision  variables.  Decision  variables  are  parameters 
that  may  be  controlled  and  are  sometimes  referred  to  as 
"control”  variables.  These  variables  represent  the 
items  that  will  be  optimized  when  solving  the  model. 

The  USASDC  presently  manages  thirty-five  WPDs  that 
were  categorized  as  "major  projects"  in  Chapter  II. 
These  are  projects  that  in  FY  86  were  funded  at 
levels  exceeding  $5  million  or  are  deemed  important 
enough  to  warrant  special  attention.  The  major 

projects  will  be  the  focus  of  the  model  and  are  listed 
in  Table  15.  Funding  for  the  major  projects  constitute 
89.8%  of  the  total  USASDC  core  budget  level,  a  clear 
indication  of  the  prominence  of  these  projects  in  the 
overall  SDI  program. 

The  decision  variables  in  the  formulated  model  are 
the  costs  associated  with  each  major  project  in  FY  88. 
XJ  is  the  notation  used  to  indicate  the  funding  level 
in  dollars  of  the  J th  project.  The  ultimate  purpose  of 
the  model  development  is  to  determine  the  optimal 
values  of  these  decision  variables. 


TABLE  15 

MAJOR  USASDC  PROJECTS 


Program 

Element 

WPD  # 

WPD  Title 

SABM 

B122 

B142 

B412 

B532 

B612 

Theater  Missile  Def  Architecture 
Architecture  Support  Analysis 
Battle  Mgmt7C3  Technology 

Battle  Mgmt/C3  Experimental  Sys 
National  Test  Bed 

SLKT 

LOOS 

L212 

L503 

L721 

L723 

Ground  Sys  Passive  Survival  Tech 
Army  Power  Technology 

Advanced  Materials 

CM  Technology  Base 

Ballistic  Range  Expt 

DEW 

D044 

D076 

D080 

D047 

D112 

D114 

D083 

AFOCAL  Technology 

Free  Electron  Laser  Demonstration 
Free  Electron  Laser  Site  Dev 

NPB  Accelerator  Technology 
Interactive  Discrimination 

DEW  Concept  Development  Defn 

NPB  Test  Facility 

KEW 

K222 

K623 

K624 

K225 

K323 

K325 

K524 

K321 

Exoatmospher Ic  Interceptor  Expt 
Invite.  Show,  and  Test  Forum 

ERINT  Program 

G&C  Missile  Electronics 

Seeker /Windows /Avionics 

Propulsion  Integration 

SDI  Targets 

Endoatmospher Ic  Interceptor  Expt 

SATKA 

S271 

5051 

soil 

5052 

5053 
S243 
S402 
S091 
S102 
S281 

Airborne  Optical  Adjunct  Expt 
Optical  Airborne  Measurement  Pgm 
Cobra  Judy 

Queen  Match 

Optical  Discrimination  Algorithms 
LWIR  Probe 

SATKA  Targets 

Optics  Technology 

LG  Radar  Technology 

Terminal  Imaging  Radar  Expt 

B.  SYSTEM  CONSTRAINTS 

There  are  two  types  of  constraints  present  In  most 
GP  formulations,  system  constraints  and  goal 
constraints.  System  constraints  are  "absolute" 
constraints;  they  define  the  feasible  solution  space 
that  must  be  adhered  to  before  an  optimal  or 
satisfactory  solution  can  be  considered.  Goal 


constraints  are  "nonabsolute"  In  that  the  program  seeks 
to  satisfy  such  equations  to  the  highest  level 
possible;  goal  programming  attempts  to  minimize  the 
deviation  from  a  prespecified  level,  rather  than 
attempt  to  satisfy  any  level  completely.  This  section 
is  concerned  with  the  system  constraints  Involving 
USASDC  budget  levels,  minimum  and  maximum  project 
funding  levels,  and  non-negativity  requirements. 

1 .  Budget  Levels 

The  first  system  constraint  Is  concerned  with 
the  total  amount  of  money  available  for  all  of  the 
thirty-five  major  programs  In  FY  88.  As  discussed  in 
Chapter  II,  four  different  funding  strategies  exist, 
each  one  motivated  by  a  different  FSED  completion  date. 
Since  the  funding  strategy  for  FY  88  has  not  been 
decided,  each  of  the  possible  appropriation  levels  will 
be  run  on  separate  iterations  of  the  model.  Table  16 
shows  the  funds  that  have  been  tentatively  appropriated 
to  the  sum  total  of  all  major  WPDs  for  each  funding 
strategy . 
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TABLE  16 

i 

MAJOR  PROJECTS  FY  88  TOTAL 

BUDGET  LEVELS 

V, 

Funding  Strategy 

Budget  ( $M ) 

Core 

882 . 6 

Basic 

1029 . 1 

Enhanced 

1255.4 

• 

Extended 

1383.4 

An  equation  representing  the  budget  constraint 
will  be  Included  in  each  Iteration  of  the  model.  The 
equation  mathematically  states  that  the  siim  of  the 
project  funding  levels  must  be  less  than  or  equal  to 
the  total  budget,  and  are  as  follows: 


Iteration  1:  XI  +  X2  +  X3  +  . 
Iteration  2:  XI  +  X2  +  X3  +  . 
Iteration  3:  XI  +  X2  +  X3  +  . 
Iteration  4:  XI  +  X2  +  X3  +  . 
2.  Minimum  Fundinc  Levels 


+  X35  <-  992.6 
+  X35  <-  1029.1 
+  X35  <-  1255.4 
-i-  X35  <-  1383.4 


There  is  a  minimum  amount  of  money  that  must 
be  spent  on  each  project  and,  for  many  of  the  major 
projects  being  modelled,  this  amount  is  substantial. 
Spending  on  any  project  cannot  simply  cease;  at  least 
some  money  must  be  spent  in  each  project,  if  only  to 
shut  the  program  down.  Most  programs  are  committed  to 
minimal  funding  levels  in  order  to  cover  a  variety  of 
prior  obligations  such  as  equipment  purchases,  facility 
rentals,  and  labor  contracts. 

Equations  for  the  minimum  funding  levels  will 
be  entered  in  the  model  as  shown  below: 

XI  >-  Minimum  Funding  Level  for  Project  1 

X2  >-  Minimiim  Funding  Level  for  Project  2 

• 

X35  >-  Minimum  Funding  Level  for  Project  35 
3 .  Maximum  Funding  Levels 

Similarly,  there  is  a  maximum  amount  of  money 
that  can  be  spent  on  each  project.  Upper  bounds  on 
spending  exist  because  USASDC  program  element  managers 
realize  that  there  is  a  practical  limit  to  the  amount 
of  money  that  can  be  devoted  to  single  project;  at  a 
certain  point  additional  funds  could  not  be  reasonably 
or  effectively  spent  on  the  project  in  question. 

The  maximum  funding  level  equations  are  as 
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XI  <-  Maximum  Funding  Level  for  Project  1 

X2  <-  Maximum  Funding  Level  for  Project  2 

X35  <-  Maximum  Funding  Level  for  Project  35 


A  goal  program  model  requires  that  all 
decision  variables  be  greater  than  or  equal  to  zero. 
The  positive  and  negative  deviation  variables  and  all 
other  variables  used  in  the  goal  constraints  must  be 
non-negative.  This  requirement  adds  the  following 
relations : 

XI,..,  X35,  PPOS,  PNEG,  RPOS,  RNEG ,  TPOS ,  TNEG , 

EPOS,  BNEG,  WTPNEG,  WTRPOS,  WTTPOS ,  WTBNEG  >-  0 


C.  GOAL  CONSTRAINTS 

Goal  constraints  are  mathematical  equations  that 
represent  the  objectives  of  the  scenario  being 
modelled.  In  a  model  of  the  thirty-five  major  projects 
of  the  USASDC ,  the  goal  constraints  will  parallel  the 
four  major  project  goals.  The  performance  of  each 
project  with  respect  to  each  of  these  goals  will  be 
determined  using  the  AHP  as  discussed  in  the  previous 
chapter.  Goal  constraint  equations  do  not  have 
inequalities  as  do  system  constraints.  Rather,  the 
left  hand  side  ( LHS )  of  the  equation  is  set  equal  to 
the  right  hand  side  (RHS),  thereby  forcing  residual 
values  into  either  the  positive  or  negative  deviation 
variable . 

1 .  Maximize  Military  Payoff 

Military  payoff  is  based  on  individual  project 
contributions  to  the  following:  (1)  the  SDI  long  range 
goal  of  building  a  missile  defense;  (2)  the  short  range 
goal  of  reaching  an  FSED  by  1995;  and  (3)  the  potential 
generation  of  military  spinoff  technology.  The  AHP 
will  determine  a  military  payoff  score  for  each  project 
(PI  through  P35 ) ,  and  this  score  will  be  multiplied  by 
its  respective  decision  variable  (XI  through  X35).  The 
sum  of  these  products  is  compared  to  the  RHS  of  the 
goal  constraint  by  using  positive  and  negative 


deviation  variables  (PPOS  and  PNEG).  The  RHS  is 
Intended  to  provide  an  unobtainable  objective  for  the 
LHS  of  the  equation;  the  sum  of  the  products  of  the 
military  payoff  scores  and  the  maximum  funding  level 
for  each  project  (MAXI  through  MAX35 )  provides  such  an 
objective.  The  goal  constraint  attempts  to  get  the  LHS 
as  close  to  this  unobtainable  level  on  the  RHS  as 
possible  by  minimizing  the  negative  deviation  variable. 
Since  the  RHS  level  cannot  be  reached,  the  positive 
deviation  variable  will  be  zero.  The  final  goal 

constraint  equation  representing  the  maximization  of 
military  payoff  is  as  stated  in  equation  5-1: 

(PI  “  XI)  +  ,  .  .  +  (P35  X35)  -  PPOS  +  PNEG 

-  (PI  MAXI)  +  .  .  .  +  (P35  *»  MAX35)  (5-1) 


2 .  Minimize  Project  Development  Risk 

The  second  nonabsolute  constraint  that  will  be 
formulated  concerns  project  development  risk.  There 
are  two  types  of  risk  to  be  modelled.  As  discussed  in 
Chapter  II,  the  first  is  technological  risk,  which 
refers  to  the  likelihood  of  failing  to  meet  the 
ultimate  technical  objectives  of  the  ¥PD.  The  second, 
milestone  risk,  accounts  for  the  possibility  that  the 
target  milestones  in  the  ¥PD  may  be  violated.  The  AHP 
will  be  once  again  used  to  assimilate  these  two  risks 
into  a  single  goal  constraint.  The  equation  will  be 
very  similar  to  the  other  goal  constraints.  The  LHS  is 
a  summation  of  the  risk  score  from  the  AHP  (R1  through 
R35 )  multiplied  by  the  amount  of  money  to  be  spent  on 

each  program  (XI  through  X35 ) ;  the  RHS  is  this  same 

risk  value  multiplied  by  the  mlnlm\im  funding  level 

(MINI  through  MIN35 ) .  Since  the  RHS  represents  an 

unobtainable  goal,  the  residual  will  driven  into  RPOS , 

54 


the  positive  deviation  variable  of  the  formulated  risk 
equation  shown  in  equation  5-2: 


(R1  ♦♦  XI)  +  .  .  .  +  (R35  ♦*  X35)  -  RPOS  +  RNEG 

-  (R1  “  MINI)  +  .  .  .  +  (R35  MIN35) 


(5-2) 


3 .  Minimize  Project  Development  Time 

The  minimization  of  project  development  time 
is  the  third  goal  to  be  modelled  by  the  GP .  The  two 
constituents  of  project  development  time  are  the  time 
required  to  achieve  ultimate  project  success  and  the 
time  needed  to  meet  the  FSED  requirements.  The  AHP 
program  will  be  used  to  develop  a  time  factor  for  each 
project  (T1  through  T35  ) .  This  value  is  multiplied  by 
the  decision  variables  and  these  products  summed  so 
that  they  may  be  compared  to  the  unachleveable 

objective.  Since  the  desire  is  to  minimize,  the  RHS 
should  be  an  artificially  low  value  derived  from  the 
multiplication  of  the  time  values 
funding  levels.  The  deviation  from 
driven  into  TPOS  and  the  end  result 
equation  as  shown  below: 


and  the  minimum 
the  goal  will  be 
is  a  time  goal 


(T1  *♦  XI)  +  .  .  .  +  (T35  “  X35)  -  TPOS  +  TNEG 
-  (T1  MINI)  +  .  .  .  +  (T35  *  MIN35  ) 


(  5-3) 


4 .  Maximize  project  development  balance 

The  fourth  goal  to  be  modelled  is  to  maximize 
project  development  balance.  The  AHP  will  assist  in 
modelling  this  objective  by  combining  the  following 
four  elements  of  project  balance  into  one  number 
between  0  and  1:  technology  base,  concepts  and  designs, 
data  collection,  and  signature  measurements.  Contrary 
to  the  other  goal  constraints,  the  second  level  AHP 
hierarchical  values  will  not  be  equal.  Rather,  the 
eigenvalues  calculated  for  each  balance  sub-factor  will 


be  multiplied  by  the  BTP  guidance  values  shown  in  Table 
1.  This  will  ensure  that  each  element  of  balance  is 
given  priority  according  to  the  goals  expressed  by  the 
1986  Budget  Priorities  briefing  [Ref.  3].  This  will 
generate  balance  values  (B1  through  B35 )  that  can  then 
be  used  as  shown  above  in  the  other  goal  constraints. 
The  RES  side  number  will  be  the  same  unobtainable 
maximum  value  that  was  used  in  the  other  maximizing 
goal  constraint,  payoff.  The  value  of  BPOS  will  be 
zero,  and  the  deviation  from  the  goal  will  be  captured 
by  BNEG.  The  final  goal  constraint  for  the  model 
formulation  is  as  displayed  in  equation  5-4: 


(B1  XI)  +  .  .  .  +  (B35  **  X35)  -  BPOS  +  BNEG 

-  (B1  MAXI)  +  .  .  .  +  (B35  MAX35) 

D.  ACHIEVEMENT  FUNCTION 


(5-4  ) 


The  final  step  in  the  model  development  is  the 
establishment  of  the  achievement  function.  Given  that 
there  is  some  solution  to  the  multiple  objective  model 
as  represented  by  the  goal  formulations  described 
above,  the  critical  task  of  finding  the  optimal 
solution  still  remains.  The  achievement  function  is 
designed  to  perform  such  a  task  by  minimizing  the  goal 
deviation  variables. 

There  are  eight  deviation  variables  that  are 
included  in  the  GP  model,  a  positive  and  negative 
deviation  variable  for  each  of  the  four  goal 
constraints.  Goals  one  and  four  are  maximizing  goals, 
so  variables  PNEG  and  BNEG  will  retain  the  goal 
deviations  that  are  to  be  minimized.  Likewise,  goals 
two  and  three  are  minimization  equations,  so  RPOS  and 
TPOS  are  included  in  the  achievement  function. 

If  the  four  goals  were  considered  equal  in  rank  or 
Importance,  the  LHS  of  the  achievement  function  would 


consist  of  a  s\immatlon  of  the  four  deviations. 
However,  the  goal  constraints  for  this  model  of  the 
thirty-five  major  SDI  projects  are  not  equal  In 
priority.  Maximizing  payoff  Is  the  most  Important 
goal ,  and  maximizing  balance  Is  the  lowest  priority 
objective.  The  AHP  will  determine  the  magnitude  of  the 
differences  between  the  four  goal  constraints;  this 
magnitude  will  be  reflected  In  weight  values  for  each 
goal  equation  between  0  and  1.  The  LHS  consists  of  the 
s\im  of  the  product  of  each  weight  value  (WTPNEG, 
WTRPOS,  WTTPOS,  WTBNEG)  multiplied  by  Its  respective 
deviation  variable.  The  LHS  is  set  equal  to  a  ‘single 
variable,  DEVIATION,  and  minimization  of  the  RHS  value 
will  determine  the  optimal  solution.  The  achievement 
function  Is  as  displayed  In  equation  5-5. 

(WTPNEG  ♦»  PNEG)  +  (WTRPOS  ••  RPOS )  + 

(WTTPOS  »»  TPOS)  +  (WTBNEG  »  BNEG )  -  DEVIATION  (5-5) 

E.  THE  GOAL  PROGRAM  FORMULATION 

The  final  formulated  GP  model  encompasses  all  of 
the  equations  described  above  and  is  as  shown  on  the 
next  page  in  Figure  4. 

F.  MODEL  ASSUMPTIONS 

There  are  several  assumptions  that  are  being  made 
for  this  model,  situations  that  are  assumed  to  be  true 
in  order  to  simplify  the  model  and  make  It  solvable. 
The  negation  of  any  of  these  assumptions  Invalidates 
the  model  developed  above. 

The  first  model  assximptlon  Is  that  all  equations  In 
the  GP  model  are  linear.  This  Is  the  most  Important 
assumption,  since  It  allows  a  great  simplification  of 
the  data  collection  process  and  model  formulation. 
Linearity  is  assumed  because  there  Is  not  enough 


Achievement  Function 


Minimize : 


(WTPNEG  »♦  PNEG)  +  (WTRPOS  »*  EPOS)  + 

(WTTPOS  TPOS)  +  (WTBNEG  BNEG)  -  DEVIATION 

Goal  Constraints 

Subject  to; 

(PI  ••  XI)  +  .  .  .  +  (P35  **  X35)  -  PPOS  +  PNEG 

-  (PI  •*  MAXI)  +  .  .  .  +  (P35  •»  MAX35) 

(R1  ^  XI)  +  .  .  .  +  (R35  »•  X35)  -  RPOS  +  RNEG 

-  (R1  “  MINI)  +  .  .  .  +  (R35  *  MIN35 

(T1  •*  XI)  +  .  .  .  +  (T35  X35)  -  TPOS  +  TNEG 

-  (T1  “  MINI)  +  .  .  .  +  (T35  •*  MIN35  ) 

(B1  ••  XI)  +  .  .  .  +  (B35  »  X35)  -  BPOS  +  BNEG 

-  (B1  “  MAXI)  +  .  .  .  +  (B35  “  MAX35) 


System  Constraints 


XI  +  .  .  .  +  X35 


<-  BUDGET 
>-  MIN  1 

>-  MIN  2 

• 

>-  MIN  35 
<-  MAXI 
<-  MAX2 


X35  MAX35 

XI,..,  X35,  PPOS,  PNEG,  RPOS,  RNEG,  TPOS,  TNEG, 
BPOS,  BNEG,  WTPNEG,  WTRPOS,  WTTPOS ,  WTBNEG  >-  0 


Figure  4  -  Goal  Program  Formulation 


Information  to  postulate  any  other  functional  form.  One 
can  be  quite  certain  that  none  of  the  equations  above 
In  reality  are  exactly  linear,  but  In  the  absence  of 


data  to  the  contrary,  linearity  is  assumed  to  be  a 
close  approximation  to  the  actual  curves.  This  is 
especially  true  since  the  solution  space  Is  being 
bounded  by  upper  and  lower  funding  levels,  which  should 
constrain  the  model  to  the  region  where  the  linear 
assTimptlon  Is  particularly  accurate. 

The  second  assumption  Is  that  all  variables  In  the 
mathematical  model  are  continuous.  This  Is  a  common 
assumption  In  models  such  as  the  one  presented  here. 
The  capability  of  doing  Integer  or  noncontlnuous 
programming  exists  and  could  be  implemented,  but  this 
would  only  add  needless  complexity  to  the  solution 
process.  Asstimlng  that  all  variables  are  continuous 
poses  no  major  practical  obstacles. 

In  Chapter  II,  the  four  project  goals  regarding 
payoff,  risk,  time,  and  balance  were  developed.  Each 
of  these  goals  had  various  components  that  made  up 
these  goals,  and  the  AHP  will  determine  an  overall 
payoff,  risk,  time  and  balance  welglt  factor  based  on 
these  sub-goals.  The  third  major  model  assumption  Is 
that  these  sub-goals  are  equal  In  priority.  For 
example,  under  the  risk  goal,  milestone  risk  and 
technological  risk  are  assumed  to  be  the  same  in 
Importance.  The  AHP  has  the  capability  of  handling  a 
situation  in  which  this  assumption  was  not  true,  but 
there  Is  not  sufficient  information  concerning  the  sub¬ 
goals  to  conclude  or  assume  differently. 

Another  key  ass\imptlon  Is  that  the  program  element 
managers  are  the  best  Individuals  to  respond  to  the  AHP 
survey.  Much  has  already  been  said  about  the  vast 
expertise  that  they  possess,  and  It  was  the 
overwhelming  consensus  of  the  chain  of  command  at  the 
USASDC  that  program  element  managers  were  best  suited 
to  make  the  subjective  judgments  upon  which  the  AHP 


model,  and  the  subsequent  GP  model,  Is  based.  If  this 
assumption  was  not  true,  than  the  model  developed  In 
this  chapter  would  not  be  valid. 

The  final  major  ass\imptlon  to  be  discussed  Is  that 
the  total  funding  level  for  the  major  USASDC  projects 
In  FY  88  is  not  known,  and  that  the  four  funding 
strategies  (core,  basic,  enhanced,  and  extended)  are 
the  only  alternatives.  The  model  could  be  easily 
changed  to  handle  any  funding  strategy,  but  It  will  be 
assumed  that  only  the  four  strategies  mentioned  In  the 
USASDC  Budget  Priorities  Briefing  [Ref.  3]  are  of 
concern.  This  assumption  Is  most  Important  In 

simplifying  the  data  analysis  of  Chapter  VI. 
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VI .  SOFTWARE  SUPPORT  AND  MODEL  RESULTS 

As  stated  In  Chapter  II,  the  primary  objective  of 
this  study  Is  to  develop  a  research  and  development 
project  funding  model  of  the  major  USASDC  projects,  and 
to  use  this  model  to  determine  optlm\im  expenditure 
levels  for  each  project  In  FY  88.  Such  a  model  has  now 
been  completely  developed,  and  this  chapter  Is  Intended 
to  present  both  the  computer  programs  written  to  solve 
the  model  and  the  model  results.  Specifically,  this 
entails  a  discussion  of  the  data  collection  and 
software  development  process,  the  numerical  output 
acquired  from  the  various  model  Iterations,  and  the 
consequences  of  the  data  produced. 

A.  DATA  COLLECTION  AND  SOFTWARE  DEVELOPMENT 

The  process  of  collecting  data  and  designing 
software  to  support  the  GP  model  formulation  Is  an 
essential  step  in  determining  the  optlmtun  expenditure 
levels  for  each  major  project  in  FY  88.  As  discussed 
earlier,  the  GP  model  requires  that  the  coefficient 
weights  for  the  goal  and  system  constraints  be 
determined  by  the  AHP ,  in  addition  to  the  achievement 
function  weights.  Program  element  managers  were 
selected  to  respond  to  a  pairwise  comparison  survey 
that  was  designed  to  subjectively  evaluate  the  major 
projects  being  studied  on  the  basis  of  the  eleven  key 
factors  discussed  earlier.  A  detailed  description  of 
this  data  collection  effort  and  a  copy  of  the  actual 
surveys  that  were  written  can  be  found  In  Appendix  C. 

Computer  software  was  written  that  would  perform 
the  necessary  AHP  calculations  and  determine  the 
coefficient  weights  for  the  GP  model.  APL  [Ref.  38] 
was  the  computer  language  chosen  to  perform  the  AHP 


calculations,  since  APL  is  particularly  powerful  when 
performing  array  computations.  An  APL  workspace  called 
"AHP",  consisting  of  nine  APL  functions,  was  written  on 
an  IBM  PC  using  "APL  Plus  5.o",  an  APL  program  compiler 
produced  by  STSC .  The  workspace  was  intended  to  be 
easy  to  use  and  have  a  broad  range  of  applicability. 
All  programs  were  generalized,  so  that  the  AHP  can  be 
used  on  any  subjective  data  array,  not  Just  the  USASDC 
data  set  presented  here.  The  programs  were  also 
designed  to  be  Interactive,  so  that  a  user  is  prompted 
for  the  information  needed  as  the  program  progresses,  a 
feature  that  helps  avoid  confusion.  Appendix  D 
contains  the  complete  program  listings  of  all  nine  APL 
functions,  as  well  as  detailed  Information  on  how  to 
use  the  workspace. 

The  Generalized  Algebraic  Modelling  System  (GAMS) 
[Ref.  41]  was  selected  to  solve  the  GP  model.  GAMS  is 
significant  because  it  is  the  first  optimizing  program 
that  uses  the  special  notation  called  the  Backus-Nauer 
Form  (BNF).  This  notation  enables  the  user  to  write 
constraint  equations  in  precise  mathematical  form, 
greatly  enhancing  the  flexibility  and  simplicity  of  the 
program  code.  A  GAMS  program  was  written  for  each  of 
the  four  possible  funding  strategies  based  on  the  GP 
model  of  the  major  projects  of  the  USASDC.  Appendix  E 
contains  the  complete  listing  of  the  GAMS  program  for 
the  core  funding  strategy,  and  it  also  Includes  a  more 
detailed  discussion  of  how  the  program  was  constructed. 

B .  MODEL  RESULTS 

The  output  from  the  AHP  procedure  and  the  GP  model 
will  be  surveyed  in  this  section.  This  evaluation  will 
Include  an  analysis  of  the  optimal  funding  levels  for 
each  major  project  and  the  optimal  funding  priorities 
at  each  budget  strategy  (core,  basic,  enhanced. 


extended).  The  optimal  funding  levels  and  priority 
lists  obtained  by  the  model  will  be  compared  with  those 
that  have  been  proposed  for  FY  88. 

1.  AHP  RESULTS 

The  AHP  surveys  were  collected  and  the 
pairwise  comparison  data  from  these  surveys  was  entered 
into  the  APL  "AHP”  workspace.  A  complete  iteration  of 
the  AHP  program  Involves  55  matrices,  derived  from 
comparisons  of  projects  within  each  program  element. 
As  stated  in  the  second  chapter,  these  comparisons  are 
based  on  eleven  components.  Each  component  contributes 
to  either  the  payoff,  risk,  time,  or  balance  factor. 
The  initial  run  of  the  AHP  program  was  not  successful, 
since  several  of  the  55  compared  matrices  were 
determined  to  be  inconsistent,  le,  the  consistency 
ratio  for  these  matrices  was  above  10?^.  Respondents 
liable  for  the  survey  completion  were  contacted, 
informed  of  the  problem,  and  asked  to  make  corrections 
in  their  responses  that  would  reduce  the  CR  for  each 
inconsistent  matrix  to  an  acceptable  level.  The  second 
iteration  of  the  AHP  was  successful  in  resolving  this 
issue,  as  is  demonstrated  in  Table  17  below. 


TABLE  17 

AHP  CONSISTENCY  RATIO  RESULTS 


FACTOR 


PAYOFF 

RISK 

TIME 

BALANCE 

TOTAL 

#  MTXS 

15 

10 

10 

20 

55 

MEAN 

.  048 

.  047 

.  045 

.004 

.  031 

STD  DEV 

.  029 

.  028 

.033 

.007 

.031 

RANGE 

.  097 

.082 

.089 

.021 

.097 

Each  of  the  factors  had  an  average  CR  value 
under  1096,  and  not  one  of  the  55  matrices  was 


found  to  be  inconsistent.  It  is  critical  to  the  GP 
model  that  the  standard  for  consistency  not  be 
violated,  since  inconsistency  will  adversely  affect  the 
accuracy  and  credibility  of  the  model. 


TABLE  18 

AHP  COEFFICIENT  WEIGHTS 


Factor 


ProJ  ect 

Payoff 

Hlsk 

Time 

Balance 

B122 

.  024 

.048 

.049 

.  025 

B142 

.  048 

.007 

.  006 

.025 

B412 

.  02 

.048 

.049 

.027 

B532 

.  044 

.007 

.  006 

.  033 

B612 

.  006 

.033 

.  033 

.  033 

L008 

.  03 

.  028 

.  035 

.  029 

L212 

.  032 

.028 

.  035 

.  029 

L503 

.  037 

.041 

.  028 

.  029 

L721 

.022 

.023 

.  023 

.029 

L723 

.  022 

.023 

.023 

.029 

D044 

.06 

.009 

.007 

.  03 

D076 

.06 

.009 

.015 

.027 

D080 

.  015 

.029 

.  035 

.027 

D047 

.  032 

.01 

.  008 

.  027 

D112 

.  005 

.064 

.  065 

.  03 

D114 

.  004 

.075 

.  065 

.  03 

D083 

.  024 

.005 

.005 

.027 

K222 

.  067 

.013 

.021 

.  036 

K623 

.  005 

.  082 

.  021 

.  036 

K624 

.  024 

.026 

.  049 

.021 

K225 

.027 

.011 

.  031 

.021 

K323 

.  027 

.01 

.031 

.021 

K325 

.027 

.01 

.  031 

.021 

K524 

.007 

.066 

.025 

.036 

K321 

.045 

.01 

.  018 

.  036 

S271 

.045 

.019 

.  019 

.  033 

S051 

.  023 

.04 

.  027 

.  03 

soil 

.  02 

.  104 

.  081 

.  03 

S052 

.  025 

.034 

.  027 

.  03 

S053 

.  03 

.  012 

.  Oil 

.  028 

S243 

.  049 

.  007 

.  008 

.024 

S402 

.019 

.  02 

.  033 

.  024 

S091 

.  036 

.011 

.016 

.034 

S102 

.  02 

.018 

.  032 

.  028 

S281 

.018 

.022 

.031 

.024 

The  objective  of  the  AHP  was  to  produce 
coefficient  weights  for  the  goal  constraints  and  the 
achievement  function.  The  AHP  workspace  gave  values 
for  these  weights,  rounded  to  three  decimal  places,  as 
displayed  in  Table  18.  A  more  complete  collection  of 


the  output  from  the  AHP  workspace  can  be  found  in 
Appendix  F.  The  payoff  factor  eigenvector  and  the  15 
matrices  that  contributed  to  its  calculation  is 


included  in  this  appendix. 

The  determination  of  the  four  factor  weights  in 
the  achievement  function  was  also  found  via  the  AHP 
workspace.  These  weights  are  extremely  Important,  as 
they  represent  the  relative  priorities  of  the  payoff, 
risk,  time,  and  balance  goal  constraints  in  the  GP 
model.  The  comparison  matrix,  consistency  information, 
and  weight  eigenvector  regarding  the  achievement 
function  is  shown  in  Table  19. 


TABLE  19 

ACHIEVEMENT  FUNCTION  AHP  RESULTS 
Comparison  Matrix 


Payoff 

Risk 

Time 

Payoff 

1)2 

1/5 

Risk 

____ 

1)3 

Time 

~5'~ 

3 

1 

Balance 

7 

5 

2 

Balance 

1/7 

1/5 

1/2 

1 

Lambda:  4.020 
Consistency  Index:  .007 
Consistency  Ratio:  .007 

Payoff  weight:  .527 

Risk  weight;  .301 

Time  weight;  .110 

Balance  weight;  .063 


2 .  GP  Results  -  Optimal  Funding  Levels 

The  coefficient  weights  for  the  goal 
constraints  and  the  achievement  function  determined 
above  were  Incorporated  in  the  GAMS  program.  The 
optimal  funding  levels  for  each  project  are  displayed 
in  Table  20. 


TABLE  20 

OPTIMAL  PROJECT  FUNDING  LEVELS  ($M) 


Project  Core 


Funding  Strategy 

Basic  Enhanced  Extended 


Table  20  shows  AHP  results  from  each  model 
Iteration.  The  only  change  between  r\ins  was  that  the 
budget  level  system  constraint  RHS  was  Increased  for 
each  successive  repetition.  For  example,  the  core 
Iteration  used  a  budget  figure  of  $882.6  million;  this 
was  altered  to  $1029.1  million  for  the  basic  run. 
Appendix  G  contains  the  solution  summary  and  several 
additional  reports  from  each  of  the  four  budget 
strategy  model  repetitions. 
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A  significant  observation  is  that  almost  all 
projects,  regardless  of  the  funding  strategy,  are 
funded  at  a  level  equal  to  either  the  minimiim  or 
maximum  bound  of  that  project.  The  GP  optimizer 
selects  projects  that  contribute  the  most  to  the 
achievement  function  for  funding  above  the  minimum 
level.  Once  an  "efficient”  project  such  as  this  is 
identified,  the  optimizer  adds  to  the  decision  variable 
until  the  project  reaches  its  upper  bound,  or  the 
budget  is  exhausted. 

Only  projects  that  provide  the  most  payoff 
and/or  balance  while  costing  little  in  risk  and/or  time 
are  deemed  efficient,  and  these  projects  can  be 
Identified  by  observing  the  marginal  values.  The 
marginal  values  for  the  individual  projects  at  each 
model  r\in  (see  Appendix  G)  Indicate  the  rate  at  which 
the  objective  function  value  Improves  as  the  RHS 
increases  a  small  amount.  Since  the  GP  model  attempts 
to  minimize  the  deviation  variable  in  the  achievement 
function,  only  the  projects  with  a  negative  marginal 
value  are  funded  above  the  minimum  bound. 

The  budget  increases  56.75^  from  the  core  to 
the  extended  strategy,  so  it  was  expected  that  many 
projects  would  demonstrate  a  dramatic  Increase  in 
funding.  The  number  of  projects  funded  at  the  minimum 
level  In  the  core  strategy  was  28,  a  figure  that 
dropped  to  14  at  the  extended  budget  strategy  level. 
The  optimization  program  does  not  Increment  each 
program  a  small  amount  when  given  additional  budget 
money.  Rather,  it  finds  additional  projects  that 
enhance  the  achievement  function  and  then  uses  these 
projects  to  the  fullest  extent  possible. 

Another  critical  aspect  of  the  GP  model 
results  concerns  the  difference  between  the  optimal 


funding  levels,  as  determined  by  the  model,  and  the 
proposed  funding  levels.  The  FY  88  proposed  levels 
were  discussed  In  Chapter  II  and  can  be  found  in 
Appendix  B.  The  optimal  and  the  proposed  funding 
levels  for  each  of  the  four  budget  strategies  are 
plotted  against  each  other  in  Figures  5  through  8  on 
the  following  pages.  The  funding  levels  for  the 
various  projects  are  on  the  y-axls  and  the  projects 
(represented  in  order  and  numbered  1  through  35)  are 
displayed  on  the  x-axls.  In  viewing  these  graphs,  the 
optimal  and  proposed  funding  levels  appear  closely 
related.  The  y-axis  scale  accentuates  the  difference 
between  the  two  levels,  but  one  cannot  be  certain  that 
this  difference  is  substantial.  A  statistical  test  is 
needed  to  make  this  Important  determination. 

The  nonparametr ic  Kolmogorov-Smlrnov  two- 
sample  goodness  of  fit  (K-S)  test  was  used  to  decide  if 
the  proposed  and  optimal  distribution  functions  are 
identical.  The  K-S  test  calculates  the  maximum 
distance  between  the  cinnulative  distribution  functions 
of  the  two  samples.  If  the  deviation  is  large  enough, 
the  null  hypothesis  that  the  distributions  are  the  same 
is  rejected.  A  deviation  figure,  DN ,  is  calculated  and 
compared  against  the  critical  deviation  figure  found  in 
a  K-S  test  table,  a  number  based  on  the  sample  size  and 
significance  level.  The  PC  statistical  graphics 
program  "Statgraphlcs " ,  published  by  STSC  [Ref.  44], 
was  used  to  determined  DN  and  an  associated  P-value. 
Small  DN  and  large  P-values  support  the  null  hypothesis 
that  the  two  distributions  are  the  same.  With  a  .05 
level  of  significance,  the  null  hypothesis  cannot  be 
rejected  if  the  P-value  is  greater  than  .05  [Ref.  43]. 

The  K-S  procedure  is  generally  more  efficient 
that  the  Chi-square  test  for  goodness  of  fit,  and  is 
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Figure  5  -  Core  Budget  Strategy 
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Figure  6  -  Basic  Budget  Strategy 
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Figure  7  -  Enhanced  Budget  Strategy 
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Figure  8  -  Extended  Budget  Strategy 
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highly  sensitive  to  population  differences  with  respect 
to  location,  dispersion,  or  skewness.  The  K-S  test  was 
performed  on  the  optimal  and  proposed  funding  levels 
for  each  budget  strategy,  and  the  results  are 
summarized  below  in  Table  21. 


TABLE  21 

OPTIMAL  AND  PROPOSED  FUNDING  LEVELS 
Kolmogorov-Smlrnov  Two  Sample  Test  Results 


Strategy 

Core 

Basic 

Enhanced 

Extended 


.3142 

.3714 

.2857 

.2000 


Slg  Level 

7o630 
.0160 
.1148 
.  4858 


A  review  of  these  results  leads  to  the 
deduction  that  the  optimal  and  proposed  funding  levels 
are  very  similar.  The  null  hypothesis  can  be  rejected 
at  only  the  basic  funding  strategy,  and  the  association 
between  the  two  is  particular  strong  at  the  enhanced 
and  extended  levels.  These  results  support  the 
intuitive  Inference  of  Figures  5-8;  they  show 
satisfactory  correlation  between  the  two  distributions, 
particularly  at  the  upper  spending  stages.  However,  it 
is  clear  that  several  projects  at  each  strategy  level 
exhibit  substantial  differences  that  demand  attention. 

3 .  GP  Results  -  Optimal  Priority  List 

The  marginal  values  from  the  GP  model  output 
that  were  mentioned  above  provide  information  that 
makes  possible  a  determination  of  project  priority  at 
each  budget  strategy.  Appendix  B  contains  the  priority 
list  of  projects  presently  used  by  the  USASDC .  A 
comparison  of  the  present  USASDC  priority  list  with  the 


optimal  one  derived  from  the  GP  model  would  provide 
additional  Insight. 

The  marginal  values  Indicate  the  order  In 
which  the  projects  are  selected  for  funding  above  the 
minimum  bound.  Projects  that  have  the  smallest 
marginal  values  are  those  that  are  valued  by  the 
optimizer  the  most.  For  example,  a  project  with  a 
marginal  value  of  -.025  was  given  additional  funds  by 
the  optimizing  program  prior  to  a  project  with  a 
marginal  value  of  -.005. 


TABLE  22 

OPTIMAL  PRIORITY  LIST  OF  MAJOR  PROJECTS 


Number 

ProJ  ect 

Marg 

Number 

Project 

Marg 

1 

K222 

-To313 

19 

L721 

-7o034 

2 

D044 

-.0294 

20 

L723 

-.0037 

3 

D076 

-.0285 

21 

S102 

-.0038 

4 

S243 

-.0242 

22 

S402 

-  .  0010 

5 

B142 

-.0232 

23 

S052 

-.0013 

6 

B532 

-.0221 

24 

S281 

-.0002 

7 

K321 

-.0204 

25 

K624 

-1 .6E-3 

8 

S271 

-.0178 

26 

D080 

-1 . 3E-3 

9 

S091 

-.0150 

27 

D412 

-0.4E-3 

10 

D047 

-.0141 

28 

S051 

.  0023 

11 

S053 

-  .0120 

29 

B122 

.  0061 

12 

D083 

-  .  0129 

30 

B612 

.  0090 

13 

K325 

-.0082 

31 

K524 

.  0172 

14 

K225 

-  .  0083 

32 

D112 

.  0233 

15 

K323 

-.0083 

33 

K623 

.  0235 

16 

L212 

-.0064 

34 

D114 

.  0264 

17 

L503 

- . 0051 

35 

SOU 

.  0297 

18 

L008 

-  .  0057 

The  priority  list  shown  In  Table  22  was 
determined  by  simply  rank  ordering  the  various  project 
marginal  marginal  values.  A  noteworthy  observation  Is 
that  the  priority  list  does  not  change  for  any  of  the 
budget  strategy  model  Iterations,  or  any  other  budget 
level  selected.  The  marginal  values  change,  but  the 
rank  ordering  does  not,  so  the  optimal  priority  list  of 
preferred  projects  can  be  determined  at  any  budget 


level  in  the  feasible  region  of  the  model  solution. 
Table  22  displays  the  priority  list  and  marginal  values 
derived  at  a  budget  level  of  $1615.1  million. 

The  $1615.1  million  funding  level  is 
significant  because  at  this  level  the  achievement 
function  reaches  its  lowest  value.  At  funding  levels 
greater  than  $1615.1  million  the  objective  value  does 
not  decrease,  despite  the  infusion  of  additional  funds 
into  the  model.  This  demonstrates  that  the  bottom 
eight  projects  on  the  priority  list  of  Table  22  will 
not  contribute  to  the  achievement  function  at  any 
budget  level,  since  the  marginal  values  are  always 
positive.  The  $1615.1  million  funding  level  identifies 
those  projects  that  do  not  contribute  to  the  goals  of 
the  USASDC ,  no  matter  how  much  research  and  development 
money  is  available.  In  these  tinfortunate  Instances  the 
payoff  and/or  balance  benefits  are  exceeded  by  the  risk 
and/or  time  drawbacks  and  money  spent  on  them, 
according  to  the  model,  is  wasted. 

Similarly,  the  top  seven  projects  are 
identified  by  the  priority  list.  These  are  all 
projects  that  have  highly  favorable  marginal  values, 
le,  less  than  -.20.  It  should  also  be  noted  that  each 
of  these  projects  is  optimally  funded  at  their 
respective  maximum  levels  at  even  the  lowest  budget 
levels.  These  top  seven  projects  contribute  the  most 
to  minimizing  the  goal  constraint  equations  and 
optimizing  the  achievement  function. 

A  comparison  between  the  proposed  and  the 
optimal  priority  lists  was  made  graphically  in  Figure 
9.  The  plot  of  the  difference  vector  makes  it  obvious 
that  there  is  little  similarity  between  the  two 
priority  lists.  This  supposition  was  verified  by  using 
Kendall’s  test  for  rank  correlation,  a  nonparametr Ic 


KANK  DIFFERENCE 


procedure  for  determining  a  correlation  coefficient, 
called  Kendall’s  Tau,  based  on  rank.  A  Kendall’s  Tau 
coefficient  close  to  1.0  demonstrates  a  high  degree  of 
agreement  between  the  two  vectors.  In  this  case,  the 
tau  statistic  was  computed  using  Statgraphlcs  and  found 
to  be  .1193.  This  low  correlation  coefficient  supports 
the  hypothesis  that  the  two  priority  lists  are 
significantly  different. 


VII.  SENSITIVITY  ANALYSIS 


In  previous  chapters,  a  model  was  developed  based 
on  several  key  elements  of  data  that  were  obtained  from 
surveys  regarding  the  ma;)or  projects  presently  being 
funded  by  the  USASDC .  It  Is  obvious,  however,  that 
responses  to  these  surveys  may  not  be  perfect;  the  data 
used  may  be  subject  to  error,  and  resource 
availabilities  and  subjective  evaluations  can  change 
with  time.  It  is  the  purpose  of  this  chapter  to 
analyze  the  impact  of  changes  in  the  goal  programming 
model.  Specifically,  this  entails  determining  the 
sensitivity  of  the  model  to  changes  of  the  following: 
(1)  total  USASDC  budget;  (2)  minimum  and  maximum 
project  funding  levels;  (3)  goal  constraint 
coefficients;  and  (4)  achievement  function 

coefficients . 

A.  CHANGES  IN  TOTAL  USASDC  BUDGET 

The  model  was  designed  to  handle  changes  in  the 
total  USASDC  budget  with  ease,  and  five  different 
budget  levels  iterations  were  discussed  in  the  last 
chapter.  The  possible  budget  levels  that  can  be  run  on 
the  model  are  infinitely  many,  as  long  as  the  budget 
figure  is  within  the  bounds  established  by  summing  the 
various  project  minimum  and  maximum  funding  levels, 

!  $348  million  and  $1788.9  million  respectively. 

I  However,  possible  as  it  is  to  run  model  iterations  with 

a  budget  figure  of  $1788.9  million,  it  really  is  not 
practical  to  exceed  $1615.1  million.  This  was  the 
budget  level  identified  in  the  Chapter  VI  as  the  point 
where  the  achievement  function  is  minimized;  budget 
levels  above  this  do  not  enhance  model  performance. 


Each  total  budget  will  yield  different  funding 
levels  for  each  project.  However,  the  optimal  priority 
list,  as  discussed  in  Chapter  VI,  does  not  fluctuate 
with  budget  variations.  This  fact  enables  the  use  of 
the  optimal  priority  list  as  a  predictive  tool  that 
greatly  enhances  the  validity  of  the  model.  For 
example,  consider  budget  variations  in  the  vicinity  of 
the  core  strategy  level,  $882.9  million.  At  this  level 
the  first  seven  projects  on  the  priority  list  were 
funded  at  the  maximvim  level  and  the  eighth  project, 
S271,  was  optimized  at  a  level  higher  than  its  minlmxim, 
but  less  than  its  maximum.  If  additional  R&D  funds  are 
somehow  made  available,  the  priority  list  indicates 
that  the  model  will  initially  spend  this  money  on  S271 
until  it  reaches  its  maxlmtim  level.  If  still  more 
funds  are  accessible,  the  model  will  allocate  the  money 
to  the  ninth  project  on  the  priority  list.  Likewise, 
if  the  budget  is  reduced  from  the  basic  strategy,  the 
model  will  reduce  the  funds  devoted  to  S271  before  it 
takes  money  away  from  the  number  seven  project.  By 
Increasing  the  flexibility  and  applicability  of  the 
model  regarding  changes  in  the  total  USASDC  budget,  the 
determination  of  a  priority  list  in  Chapter  VI  can  now 
be  seen  as  an  Important  contribution  to  the  sensitivity 
of  the  model . 

B.  CHANGES  IN  MINIMUM  AND  MAXIMUM  PROJECT  BOUNDS 

Program  element  managers  provided  estimates  for  the 
minimum  and  maximum  funding  levels  for  each  project,  as 
discussed  in  Chapter  IV,  and  it  is  possible  that  some 
of  these  approximations  may  change.  Deviations  in  the 
upper  and/or  lower  bounds  can  have  a  profound  bearing 
on  the  optimal  funding  levels  computed  by  the  GP  model, 
but  once  again  the  optimal  priority  list  can  be  used  to 
help  predict  the  Impact. 


The  minimum  fiindlng  levels  must  first  be  satisfied 
before  the  model  begins  allocating  money  to  other 
projects.  Consider  a  project  that,  at  a  given  budget 
level,  Is  being  funded  at  Its  maximum  level.  A  change 
In  the  minimum  funding  level  of  this  project  will  have 
absolutely  no  effect  on  the  model  results.  Likewise,  a 
change  In  the  upper  bound  of  a  project  being  funded 
below  that  level  will  not  alter  model  output.  However, 
any  other  situation  will  vary  the  model  results.  If  a 
project  funded  at  the  minimum  has  Its  lower  bound 
reduced,  then  the  additional  money  will  be  directed  to 
the  next  available  project  on  the  optimal  priority  list 
that  has  not  yet  been  maximized.  The  same  result  will 
occur  If  a  project  funded  at  Its  maximum  level 
experiences  a  reduction  In  this  upper  bound. 

In  a  similar  manner  the  GP  model  will  take  money 
away  from  projects  according  to  the  priority  list. 
This  will  occur  If  projects  not  being  maximized  have 
their  lower  bounds  Increased,  or  maximized  projects 
have  their  upper  bounds  Increased.  Of  course,  the 
number  of  projects  that  will  be  affected  by  the  changes 
In  the  bounds  depends  on  the  nximber  and  size  of  these 
modifications.  Nonetheless,  the  Impact  of  even  large 
changes  can  be  anticipated  by  using  the  optimal 
priority  list,  a  feature  that  ensures  that  the  GP  model 
is  sufficiently  responsive  to  changes  In  the  minimum 
and  maximum  funding  levels  of  Individual  projects. 

C.  CHANGES  IN  GOAL  CONSTRAINT  COEFFICIENTS 

Survey  results  were  converted,  using  the  AHP ,  Into 
135  goal  constraint  coefficients.  The  surveys  were 
based  on  subjective  judgments  that  can  possibly  vary 
for  a  number  of  reasons.  In  this  section  an  analysis 
of  the  Impact  of  changes  In  the  subjective  evaluations 
will  be  conducted. 


The  first  situation  to  Investigate  Is  the  Impact  of 
a  mistake  in  completing  a  survey  or  transcribing  data 
from  a  survey.  One  of  the  advantages  in  using  the  AHP 
procedure  to  generate  weights  from  subjective 
evaluations  is  that  it  has  a  built-in  mechanism  to 
detect  errors  of  this  type.  This  feature  is 
illustrated  in  Table  23,  a  table  that  displays  an 
actual  matrix  taken  from  the  AHP  output  in  Appendix  F 
and  a  "flawed"  matrix  that  contains  an  input  error. 


TABLE 

23 

COMPARISON  OF 

ACCURATE  MATRIX 

WITH  FLAWED  MATRIX 

Accurate 

Matrix 

Flawed  Matrix 

112 

1 

5 

1 

12  1 

1 

X  X  2 

1 

5 

1 

12  1 

5 

1/2  1/2  1 

1 

5 

1/ 

2  1/2  1  1 

5 

XXX 

1 

5 

1 

XXX 

5 

1/5  1/5  1/5 

1/5 

1 

1 

1/5  1/5  1/5 

1 

CONSISTENCY  RATIO:  . 

017 

CONSISTENCY  RATIO; 

.117 

The  only  change  that  was  made  in  the  flawed  matrix 
is  that  the  upper  right-hand  number  was  changed  from  5 
to  1,  representative  of  a  common  typographical  error. 
The  consistency  ratio  (CR)  computation  turns  this 
simple  mistake  into  a  glaring  error  by  raising  the  CR 
to  above  10%.  Since  a  CR  this  high  is  unacceptable, 
the  matrix  data  input  would  have  to  be  examined  and  the 
error  corrected.  This  example  demonstrates  the 
sensitivity  of  the  GP  model  in  responding  to  minor 
lapses,  a  feature  that  makes  the  model  results  more 
credible . 

The  GP  model  might  also  be  subjected  to  a  change  of 
opinion.  A  respondent  to  a  survey  could  decide  that  a 
project  was  Judged  inappropriately.  Once  again  it  is 
illuminating  to  look  at  an  example  of  such  a  situation. 


Consider  the  comparison  matrix  of  KEW  projects 
according  to  milestone  risk  shown  in  Table  24. 


TABLE  24 

KEW/MILESTONE 

RISK  - 

ORIGINAL  COMPARISON  MATRIX 

K222 

K623 

K624 

K225 

K323 

K325 

K524 

K321 

K222 

1 

1/5 

1 

1 

1 

1 

1/5 

1 

K623 

5 

1 

5 

5 

5 

5 

1 

5 

K624 

1 

1/5 

1 

2 

2 

2 

1 

2 

K225 

1 

1/5 

1/2 

1 

1 

1 

1/5 

1 

K323 

1 

1/5 

1/2 

1 

1 

1 

1/5 

1 

K325 

1 

1/5 

1/2 

1 

1 

1 

1/9 

1 

K524 

5 

1 

1 

5 

5 

9 

1 

9 

K321 

1 

1/5 

1/2 

1 

1 

1 

1/9 

1 

Consistency  Ratio: 

.  031 

Eigenvector 

:  .062  .308 

.116 

.  055 

.  055  . 

051  .302 

.  051 

Suppose  the  KEW  program  element  manager  receives 
Information  Implying  that  he  overestimated  the 
milestone  risk  of  K623.  The  program  element  manager 
might  then  change  the  original  comparison  matrix  to  one 
as  shown  in  Table  25. 


K222 

1 

1 

K623 

2 

K624 

1 

1 

K225 

1 

1 

K323 

1 

1 

K325 

1 

1 

K524 

5 

K321 

1 

1 

TABLE 

25 

R 

ISON  MATRIX 

WITH  MINOR  CHANGES 

3 

K624 

K225 

K323 

K325 

K524 

K32 

2 

1 

1 

1 

1 

1/2 

1 

2 

2 

2 

2 

1 

2 

2 

1 

2 

2 

2 

1 

2 

2 

1/2 

1 

1 

1 

1/5 

1 

2 

1/2 

1 

1 

1 

1/5 

1 

2 

1/2 

1 

1 

1 

1/9 

1 

1 

5 

5 

9 

1 

9 

2 

1/2 

1 

1 

1 

1/9 

1 

82 


'  •  ■  •  ^•C*"**  l”*  ^ L'^". 


The  only  nximbers  changed  In  the  this  new  matrix  are 
those  In  the  second  row  and  second  column,  values 
corresponding  to  project  K623.  The  numbers  In  the 
original  matrix  were  larger,  signifying  that  K624 
Involves  a  high  degree  of  milestone  risk.  The  lower 
numbers  In  the  new  matrix  denote  that  the  milestone 
risk  for  K623  Is  not  as  substantial  as  the  first  matrix 
claimed.  This  Is  also  reflected  by  the  coefficient 
eigenvector.  The  largest  coefficient  change  occurred 
in  the  K623  value,  which  dropped  from  .308  to  .178,  but 
the  other  project  coefficient  weights  Increased  only 
slightly.  A  K-S  test  was  performed  comparing  the  two 
different  eigenvectors.  The  computed  P-value  was  .27, 
a  high  value  signifying  that  the  minor  changes  In  the 
comparison  matrix  did  not  significantly  alter  the 
matrix  output. 


TABLE  26 

KEW  COMPARISON  MATRIX  WITH  MAJOR  CHANGES 


K222 

K623  K624 

K225 

K323 

K325 

K524 

K321 

K222  1 

1/5 

1 

1 

1 

'  '  1 

1/5 

K623  5 

1 

1/5 

1/5 

1/5 

1 

K624  1 

5 

1 

2 

2 

1 

K225  1 

5 

1/2 

1 

1 

1 

1/5 

1 

K323  1 

5 

1  >2 

1 

1 

1 

1  /  5 

1 

K32  5  1 

0 

1,2 

I 

I  /  9 

I 

K524  5 

9 

1 

5 

5 

9 

1 

9 

K321  1 

5 

1,  2 

1 

1 

1 

1/9 

1 

i. 

Cons 

Istency  Ratio:  . 

031 

Eigenvector 

:  .  091 

.  022 

.  167 

.  081  . 

081  . 

077  .406  .077 

To  continue  with 

the 

KEW 

example 

,  Table  26 

display 

the  results  of  a  major  change  in  the  program  element 
manager’s  opinion  of  K623.  Now  the  knowledge  available 
is  such  that  the  manager  feels  K624  has  the  least 
amount  of  milestone  risk  of  any  of  the  KEW  projects. 


The  second  colvunn  and  second  row  feature  very  small 
numbers,  changes  that  have  a  big  effect  on  the 
eigenvector  of  coefficient  weights.  Not  only  has  the 
K623  coefficient  has  decreased  considerably  from  .308 
to  .022,  but  the  other  coefficients  have  all  increased 
approximately  50^.  The  K-S  test  statistic  when  this 
latest  eigenvector  is  compared  with  the  original  one  is 
.038,  indicative  that  the  two  eigenvectors  are 
considerably  different. 

The  example  above  demonstrates  the  sensitivity  of 
the  model  to  major  subjective  changes  in  the  responses 
to  the  AHP  surveys.  Despite  the  fact  that  the  KEW 
milestone  risk  eigenvector  has  been  altered  by  the 
changes,  it  remains  to  be  determined  if  this  will  have 
an  impact  on  the  overall  risk  eigenvector.  As 
discussed  in  Chapters  II  and  IV,  each  of  the  four  major 
factors  (payoff,  risk,  time,  and  balance)  are  comprised 
of  several  sub-factors.  In  the  case  of  risk,  the  sub¬ 
factors  are  technological  risk  and  milestone  risk. 

The  complete  AHP  program  was  run  with  the  modified 
matrix  and  a  new  risk  eigenvector  was  computed.  This 
eigenvector  was  compared  with  the  original  by  means  of 
the  K-S  test.  The  K-S  P-value  was  computed  as  .4858, 
so  it  is  evident  that  much  of  the  deviation  that  had 
been  stimulated  by  the  major  changes  in  the  KEW 
milestone  risk  matrix  has  been  suppressed  at  this 
higher  level  in  the  model. 

The  new  risk  eigenvector  was  substituted  into  the 
GP  model.  The  GAMS  model  was  run  at  the  core  strategy 
level  and  the  results  proved  notable.  Only  two 
projects  were  affected  by  the  new  eigenvector,  so  the 
calculated  P-value  of  .9830  comparing  the  new  with  the 
original  optimal  funding  levels  was  not  surprising. 
However,  the  fact  that  the  funding  level  for  K623  was 


not  altered  by  the  changes  was  surprising.  The  model 
took  $13  million  from  B142  and  gave  it  to  K321.  The 
new  optimal  priority  list  was  computed,  and  it  shows  a 
drop  of  several  places  in  rank  order  of  B142.  K321 
retains  its  place  on  the  list  and  since  it  is  the  next 
project  that  is  not  funded  to  its  maximum  level,  the 
funds  taken  from  B142  are  given  to  K321. 

The  discussion  above  should  point  out  the  inability 
of  the  model  to  predict  the  impact  of  major  changes  in 
subjective  evaluations.  What  began  as  a  change  in  the 
opinion  of  a  program  element  manager  regarding  project 
K623  ended  up  affecting  the  funding  levels  of  two  other 
projects.  This  result  demonstrates  the  complex 
interrelationships  of  the  goal  coefficients  and  the 
difficulty  in  anticipating  the  repercussions  of  major 
opinion  alterations.  The  model  responds  very  well  to 
simple  errors  and  minor  changes  involving  the 
subjective  evaluations,  but  major  changes  unfortunately 
demand  a  complete  reiteration  of  the  model. 

D.  CHANGES  IN  ACHIEVEMENT  FUNCTION  COEFFICIENTS 

The  most  Important  comparison  matrix  used  in  the 
model  is  the  one  that  determines  the  achievement 
function  coefficient  weights,  and  a  matrix  that  was 
displayed  and  discussed  at  length  in  the  last  chapter. 
This  section  is  concerned  with  the  Impact  of  changes  to 
the  achievement  function  coefficients. 

The  original  weights  for  the  achievement  function 
were  based  on  the  perception  that  maximizing  payoff  was 
the  most  Important  goal  of  the  GP  program,  and 
minimizing  risk  was  a  close  second  priority. 
Minimizing  time  was  Important,  but  not  as  critical  as 
the  goals  involving  payoff  and  risk.  Maximizing 
balance  was  considered  the  least  Important  objective  in 
the  achievement  function,  but  a  goal  nonetheless.  In 


mathematical  notation,  this  situation  can  be 
represented  as  shown  below  In  equation  7-1. 

Original  Ach  Fn:  Payoff  >  Risk  >  Time  >  Balance  (7-1) 

It  Is  recognized  that  the  original  goal  priorities 
used  In  the  model  might  change  someday,  since 
organizational  priorities  often  change.  Keeping  such  a 
possibility  In  mind,  the  following  four  achievement 


function  situations  were  envisioned: 

Situation  1:  Payoff  -  Risk  >  Time  >  Balance  (7-2) 
Situation  2:  Risk  >  Payoff  >  Time  >  Balance  (7-3) 
Situation  3:  Time  >  Payoff  >  Risk  >  Balance  (7-4) 
Situation  4:  Payoff  -  Risk  -  Time  -  Balance  (7-5) 


There  are  many  possible  priority  relationships,  but 
these  were  selected  as  likely  scenarios  that  could 
satisfactorily  demonstrate  the  Impact  of  achievement 
function  changes  on  the  model  results.  The  four 
situations  were  converted  Into  AHP  comparison  matrices 
according  to  the  procedure  discussed  In  Chapters  IV  and 
VI,  and  the  complete  results  of  these  AHP  Iteration  can 
be  foTind  In  Appendix  H.  The  weight  eigenvalues 
obtained  from  the  AHP  workspace  depicting  each 
achievement  function  situation  are  shown  In  Table  27. 

TABLE  27 

ACHIEVEMENT  FUNCTION  EIGENVALUES  -  SITUATIONS  1-4 

Balance 

~To63 
.056 
.048 
.041 
.250 


86 


Situation 

Payoff 

Risk 

Time 

Original 

.527 

Tsoi 

TII5 

1 

.425 

.425 

.093 

2 

.330 

.542 

.079 

3 

.250 

.152 

.  557 

4 

.250 

.250 

.250 

The  achievement  function  coefficients  from  Table  27 
were  each  programmed  Into  the  GAMS  GP  model  in  the  same 
way  that  the  original  weights  were.  The  four  different 
situations  were  run  on  the  GP  model  at  each  funding 
strategy  budget  level.  The  output  from  this  endeavor 
is  contained  in  Appendix  I.  Listed  In  Table  28  are  the 
results  of  nximerous  tests  comparing  the  ftmdlng  vectors 
and  optimal  priority  lists  derived  from  the  original 
and  supplemental  model  iterations. 


TABLE  28 

GP  RESULTS  -  SITUATIONS  1-4  COMPARED  W/  ORIGINAL 

Sit  1  Sit  2  Sit  3  Sit  4 


Core  Budget 

K-S  Deviation: 
P-value : 

.0000 

1.0000 

.  0000 
1.0000 

.2286 

.3199 

.  0000 

1 . 0000 

Basic  Budget 

K-S  Deviation; 
P-value: 

.  0000 
1.0000 

.2286 

.3199 

.2286 

.3199 

.2286 

.3199 

Enhanced  Budget 
K-S  Deviation: 
P-value : 

.0000 

1.0000 

.2876 
.  1242 

.3143 
.  0630 

.2876 
.  1242 

Extended  Budget 
K-S  Deviation: 
P-value : 

.1677 

.5632 

.3143 

.0630 

.4285 

.0032 

.3143 

.0630 

Priority  List 
Kendall’s  Tau; 

.6336 

.  5462 

-.0017 

.2539 

The  data  contained  In  Table  28  demonstrates  the 
extremely  wide  range  of  validity  that  the  GP  model 
possesses.  Situation  1  Involves  slight  changes  in  the 
coefficient  weights,  and  the  optimal  funding  levels 
selected  at  the  three  lowest  budget  levels  are 
identical  with  those  of  the  original  model.  The  P- 
value  at  the  extended  level  Indicates  that  there  is 
only  slight  deviation  from  the  original  extended 
funding  levels,  and  the  optimal  priority  list 


correlation  is  high.  In  Situation  2,  risk  has  been 
established  as  a  higher  priority  than  payoff,  but  only 
at  the  extended  funding  level  do  the  model  results  from 
this  Iteration  differ  significantly  from  the  original 
model  output.  The  Kendell  Tau  figure  Is  still  quite 
high  and  Is  testimony  to  the  similarity  between  the 
original  and  Situation  2’s  optimal  priority  list. 
Situation  4  represents  a  substantial  departui*e  from  the 
goal  priorities  established  for  the  original  model,  yet 
the  Table  28  data  shows  that  only  at  the  extended 
budget  level  can  one  reject  the  hypothesis  that  the  two 
funding  levels  are  the  same.  However,  the  Situation  4 
optimal  priority  list  does  differ  notably  from  the 
original.  Situation  3  Involves  a  radical  digression 
from  the  original  In  that  the  payoff  coefficient  has 
been  decreased  to  .152  from  .527  and  the  time 
coefficient  raised  from  .11  to  .557.  Nevertheless,  the 
funding  levels  at  the  core  and  basic  budget  strategies 
are  not  statistically  different,  further  confirmation 
of  the  excellent  flexibility  and  applicability  of  the 
GP  model  that  has  been  developed. 


VIII.  CONCLUSIONS  AND  RECOMMENDATIONS 


This  final  chapter  is  Intended  to  briefly  discuss 
the  conclusions  that  can  be  drawn  from  the  results  and 
analysis  of  the  GP  model,  as  well  as  state  the 
recommendations  that  this  study  has  motivated. 

A.  CONCLUSIONS 

1 .  Presently  proposed  project  funding  levels  are 
valid;  model  funding  levels  are  optimal. 

The  proposed  ftindlng  levels  for  the  35  major 
USASDC  projects  do  not  vary  significantly  from  the 
optimal  levels  determined  by  the  model  for  three  of  the 
budget  strategy  levels.  However,  there  is  substantial 
variation  from  optimality  at  the  basic  strategy  budget 
level.  The  similarity  between  the  optimal  and  proposed 
levels  are  acceptable  for  the  core  and  enhanced 
strategy,  but  their  respective  significance  levels  are 
low  enough  to  cause  some  concern.  The  best  course  of 
action  is  to  make  the  minor  funding  corrections  needed 
to  convert  the  proposed  levels  to  the  optimal  ones 
suggested  by  the  model. 

2 .  The  present  priority  list  in  use  is  not  valid; 
the  model  priority  list  is  optimal. 

The  project  priority  list  presently  in  use  by 
the  USASDC  differs  significantly  from  the  optimal 
priority  list.  An  accurate  priority  list  has  been 
demonstrated  in  Chapter  VII  as  an  excellent  predictive 
device,  enabling  managers  to  speculate  appropriate 
responses  to  changes  in  budget  level  and  individual 
project  bounds.  The  optimal  project  priority  list 
calculated  from  the  model  should  replace  the  present 
priority  list  so  that  an  accurate  and  effective  tool  is 
at  the  disposal  of  key  management  personnel. 


The  bottom  eight  projects  on  the 


are  not  productive. 

In  Chapter  VI  it  was  discovered  that  the  last 
eight  projects  on  the  optimal  project  priority  list  had 
non-negative  marginal  values  at  every  funding  level  in 
the  feasible  region.  This  indicates  that  these 
projects  do  not  make  any  positive  contributions  to  the 
model  goals.  In  these  unfavorable  Instances  the 
advantages  afforded  by  spending  money  on  the  projects 
are  exceeded  by  the  disadvantages  they  accrue,  so 
funding  for  these  projects  should  be  terminated  as  soon 
as  possible.  If  these  projects  are  reduced  from  their 
present  level  of  funding  to  their  respective  minimum 
funding  levels,  a  savings  of  $63.1  million  dollars  will 
be  realized. 

4.  The  top  seven  projects  on  the  priority  list 


are  particular!: 


>roductlve . 


The  top  seven  projects  in  the  priority  list 
demonstrated  highly  productive  characteristics,  as  was 
explained  in  Chapter  VI.  At  the  $1615.1  million 
funding  level,  each  of  these  projects  had  a  marginal 
value  under  -.20,  and  each  project  was  optimized  at  its 
respective  maximum  funding  level  for  every  model 
iteration.  Funding  priority  should  be  given  to  these 
very  favorable  projects. 

5.  A  total  USASDC  budget  for  the  major  project 


of  over  $1615.1  million  is  not  productive. 

The  $1615.1  million  funding  level  for  the  35 
major  projects  was  determined  as  the  point  where  the 
achievement  function  was  minimized.  Money  spent  in 
excess  of  this  amount  does  not  decrease  the  objective 
value  any  further,  since  these  additional  funds  can 
only  be  spent  on  the  ten  unproductive  projects;  at 
$1615.1  million  all  projects  that  make  favorable 


contributions  to  the  model  are  at  their  respective 
maximum  funding  levels.  Total  budget  endowments 
greater  than  $1615.1  million  should  be  diverted  to 
more  productive  research  and  development  endeavors. 

6 .  The  GP  model  developed  is  flexible  and  has  a 

wide  range  of  validity. 

The  GP  model  developed  has  been  successful  in 
meeting  all  the  objectives  of  this  study.  The  AHP  has 
been  used  to  convert  previously  vague  subjective 
evaluations  into  the  precise  mathematical  coefficients 
needed  for  a  reliable  solution.  The  GP  model  has  been 
analyzed  as  very  adaptable  to  changes  in  the  model 
parameters  and  the  R&D  environment.  Simple  and 
versatile  personal  computer  software  has  been  written 
to  support  all  computational  aspects  of  the  model.  A 
user  with  a  properly  organized  data  base  can  perform  a 
completely  new  iteration  of  the  model  in  less  than  an 
hour.  These  characteristics  help  describe  a  model 
worthy  of  wide  dissemination  and  use. 


B.  RECOMMENDATIONS 

1.  R&D  funds  in  FY  88  should  be  provided  to  each 
major  project  as  shown  in  Table  20  of  Chapter  VI 
according  to  the  budget  strategy  that  is  approved 
for  the  USASDC. 

2.  The  optimal  project  priority  list  displayed  in 
Table  22  of  Chapter  VI  should  immediately  replace 
the  present  priority  list  used  at  the  USASDC. 

3.  Steps  should  be  taken  save  $63.1  million  by 
eliminating  the  following  eight  projects  as  soon 
as  possible  (listed  in  order  of  elimination 
priority): 

a.  soil  -  Cobra  Judy 

b.  D114  -  DEW  Concept  Development  Defn 

c.  K623  -  Invite,  Show,  and  Test  Forum 


d.  D112  -  Interactive  Discrimination 

e.  K524  -  SDI  Targets 

f.  B612  -  National  Test  Bed 

g.  B122  -  Theater  Missile  Def  Architecture 

h.  S051  -  Optical  Airborne  Measurement  Pgm 
Steps  should  to  taken  to  ensure  the  following 
seven  projects  receive  maximum  priority  and 
funding  support: 

a.  K222  -  Exoatmospherlc  Interceptor  Expt 

b.  D044  -  AFOCAL  Technology 

c.  D076  -  Free  Electron  Laser  Demonstration 

d.  S243  -  LWIR  Probe 

e.  B142  -  Architecture  Support  Analysis 

f.  B532  -  Battle  Mgmt/C3  Experimental  Sys 

g.  K321  -  Endoatmoapherlc  Interceptor  Expt 
Total  funding  for  the  major  USASDC  projects  should 
not  be  allowed  to  exceed  $1615.1  million.  Excess 
funds  should  be  diverted  to  more  promising  R&D 
efforts . 

The  GP  model  developed  In  this  paper,  and  the 
associated  software  designed  to  support  it,  should 
be  Implemented  as  soon  as  possible  as  a  management 
and  planning  tool  in  the  USASDC  Program  Analysis 
and  Evaluation  Directorate. 


APPENDIX  A 

PROGRAM  ELEMENT  DESCRIPTIONS 

USASDC  technical  efforts  are  structured  into  five 
program  elements,  each  element  examining  important  SDI 
technology.  Program  element  managers  are  assigned  to 
each  program  element,  and  they  monitor  and  coordinate 
the  funding  and  conduct,  of  the  research  efforts  in  each 
area.  Many  of  these  projects  in  the  program  elements 
have  already  been  responsible  for  some  outstanding 
experimental  results.  A  discussion  of  the  focus  of 
each  of  these  program  elements  follows. 

A.  SURVEILLANCE,  ACQUISITION,  TRACKING  AND  KILL 
ASSESSMENT  (SATKA)  PROGRAM 

The  SATKA  program  provides  sensor  research  efforts 
involved  in  performing  surveillance,  acquisition, 
tracking,  discrimination  and  kill  assessment  of  hostile 
ballistic  missiles.  The  SATKA  program  is  critical  to 
the  overall  success  of  the  SDI,  since  a  target  must  be 
identified  and  tracked  before  it  can  be  destroyed. 
There  are  three  basic  sensor  types  involved  in  the 
accomplishment  of  this  important  mission: 

1.  Rocket  launch  detection  sensors  -  used  to  detect 
the  the  Initiation  of  an  attack. 

2.  Midcourse  sensors  -  employed  to  track 
atmospheric  reentry  vehicles  and  decoys  in 
mldcoarse . 

3.  Terminal  phase  sensors  -  utilized  to  track 
attacking  warheads  in  the  last  seconds  prior  to 
Impact . 

Key  components  of  the  SATKA  program  are  technology 
development  experiments  and  data  collection  efforts. 
This  program  element  has  the  largest  number  of  R&D 


projects  being  managed  by  the  USASDC  and  accounts  for 
over  of  the  Fiscal  Year  1987  budget.  Research 
efforts  are  being  concentrated  in  the  following  areas: 
radars,  laser  radars,  infra-red  sensors,  interactive 
discrimination,  and  signal  processing. 

B.  DIRECTED  ENERGY  WEAPONS  (DEW)  PROGRAM 

The  DEW  program  identifies  and  validates  the 
technology  supporting  directed  energy  systems;  it  is 
hoped  that  these  systems  will  be  able  to  discriminate 
decoys  from  warheads,  and  then  destroy  large  numbers  of 
enemy  vehicles  in  split  seconds.  This  discrimination 
and  Intercept  mission  is  key  to  achieving  high  levels 
of  ballistic  missile  defense  effectiveness. 

To  achieve  the  DEW  goal,  research  has  been 
directed  towards  technologies  that  perform  the 
functions  of  (1)  generating  a  high  energy  destruction 
beam;  (2)  conditioning  the  beam  and  delivering  it  for 
propagation  toward  the  target;  (3)  focusing  the  beam  at 
the  target  along  a  prescribed  path;  and  (4)  hitting  the 
target  and  reinitiating  the  sequence  quickly  In  order 
to  engage  a  new  target.  Thus,  the  DEW  program  Includes 
work  on  laser  devices  at  various  wavelengths;  laser 
beam  control  and  optics;  particle  beam  technology; 
pointing  and  fire  control;  and  nuclear  directed  energy 
weapons . 

The  DEW  program  has  funded  R&D  in  two  major  new 
technologies,  the  Ground  Based  Free  Electron  Laser 
(GBL)  and  the  Neutral  Particle  Beam  ( NPB ) .  Several  DEW 
projects  Involve  GBL  and  NPB  proof-of-feaslbllity  and 
data  collection  experiments. 

C.  KINETIC  ENERGY  WEAPONS  ( KEW )  PROGRAM 

R&D  efforts  in  the  KEW  program  support  all  options 
Involved  in  kinetic  energy  guided  projectiles.  As  a 


relatively  mature  set  of  technologies,  these  endeavors 
are  expected  to  provide  the  Intercept  and  kill 
functions  for  Initially  deployed  ballistic  missile 
defenses.  KEW  weapons  are  also  very  useful  In  the 
defense  of  space  platforms. 

Kinetic  energy  projectiles  rely  on  nonnuclear  kill 
mechanisms.  They  are  accelerated  by  chemically 

propelled  boosters  or  hypervelocity  electromagnets. 
Chemical  rockets  are  In  a  more  advanced  technological 
state,  but  hypervelocity  weapons  are  considered 
preferable  In  engagements  that  Involve  very  large 
numbers  of  engagements  In  short  periods  of  time. 
Hype rve 1 oc 1 ty  guns  are  also  attractive  because  of  their 
ability  to  achieve  rapid  target  kills  with  minimal 
system  weight  impact. 

The  KEW  program  is  developing  technology  In  four 
major  R&D  areas.  These  Include:  (1)  space-based 
kinetic  kill  vehicles;  (2)  ground-launched 

interceptors;  (3)  advanced  hypervelocity  rail  guns;  and 
(4)  fire  control  support  items. 

D.  SYSTEM  ANALYSIS  AND  BATTLE  MANAGEMENT  ( SABM ) 

PRObRAM 

The  SABM  program  is  concerned  with  the  management 
if  activity  on  two  diverse,  but  related  fronts. 
Systems  analysis  efforts  define  the  performance 
requirements  of  systems  that  will  constitute  the 
strategic  defense.  Battle  management  research  will 
define  the  operational  environment  of  decisions  ami 
rules  involved  in  the  collective  deployment  of  manv 
Individual  systems. 

Specific  tasks  within  the  systems  anal  vs  - 
framework  Include  the  following: 

1.  Architecture  -  defining  system  organ  1  zat  l  c'-n  . 

concepts,  and  parametric  trade-offs  that  a.  "* 


assessment  of  key  technologies  and  system 
functions . 

2.  Threat  analysis  -  projection  of  possible  threat 
structures  and  scenarios  that  will  help  define 
appropriate  US  responses. 

3.  Logistic  Integration  -  addresses  logistic 
supportablllty  Issues  across  the  entire  SDI 
program. 

Key  elements  of  battle  management  research  are 
listed  below: 

1.  Situation  assessment  ~  concerned  with  a  wide 
variety  of  algorithms  that  perform  damage 
assessment,  defensive  firing  strategies,  and 
network  management. 

2.  Command,  control,  and  communication  -  Involves 
projects  Investigating  the  rapid  passing  of 
critical  battlefield  Information  and  directives. 

3.  Battle  management  software  -  addresses  the 
development  of  some  of  the  most  complex  computer 
programming  ever  attempted;  software  that  can  make 
Instant  and  appropriate  battlefield  decisions 
according  to  programmed  Instructions. 

E.  SURVIVABILITY,  LETHALITY  AND  KEY  TECHNOLOGIES 
(SLKT)  PROGRAM 

Critical  factors  in  the  development  of  a  strategic 
defense  Include  effectiveness,  affordability  and 
survivability.  The  SLKT  program  performs  research  In 
the  key  technologies  Involving  these  factors. 
Specifically,  the  SLKT  program  manages  research 
Intended  to: 

1.  Develop  tactics  to  enhance  the  survivability  of 
defensive  components  in  hostile  environments. 

2.  Reduce  uncertainties  that  exist  In  the  US 
capability  to  predict  enemy  target  vulnerability; 


3.  Coordinate  and  stimulate  the  development  of  energy 
generation,  conversion,  and  power  conditioning 
subsystems. 

4 .  Develop  technologies  to  Improve  space 
transportation,  repair,  and  resupply. 

5.  Identify  and  manage  research  into  the  development 
of  high  technology  materials  and  structures. 

6.  Develop  tactical  and  technical  countermeasures  in 
order  to  negate  the  effectiveness  of  defensive 
strategies . 

The  SLKT  program  is  organized  into  the  following 
five  projects:  (1)  System  Survivability;  (2)  Lethality 
and  Target  Hardening;  (3)  Space  Power  and  Power 
Conditioning;  (4)  Space  Transportation  and  Support;  (5) 
Materials  and  Structures  Development;  and  (6) 
Countermeasures . 


APPENDIX  B 

PROPOSED  PROJECT  FUNDING  LEVELS  AND  PRIORITY  LIST 

The  fiindlng  levels  shown  In  the  table  below 
represent  the  presently  forecasted  funding  levels  for 
each  of  the  35  major  USASDC  projects  In  FY  88.  The 
major  projects  are  listed  In  rank  order  corresponding 
to  priority.  The  data  for  this  table  was  collected 
from  the  USASDC-Huntsvllle  Resource  Management  Office 
priority  listing,  dated  3  Dec  1986. 

PROPOSED  FUNDING  LEVELS  AND  PRIORITY  LIST 

Budget  Strategy 

Rank  Project  Core  Basic  Enhanced  Extended 


APPENDIX  C 

AHP  MAJOR  PROJECT  SURVEYS 

The  process  of  collecting  data  In  support  of  the 
GP  model  developed  in  Chapter  V  is  an  essential  step  In 
determining  the  optimum  expenditure  levels  for  each 
major  project.  This  appendix  Is  Intended  to  provide 
Information  on  the  AHP  surveys  that  were  designed  and 
implemented  to  achieve  this  end. 

The  GP  model  requires  that  the  following  data  he 
collected  regarding  each  of  the  thirty-five  major 
projects  being  modelled: 

1)  Military  payoff  weight  factor 

2)  Development  risk  weight  factor 

3)  Development  time  weight  factor 

4 )  Development  balance  weight  factor 

5)  Minimum  funding  level 

6 )  Maximum  funding  level 

The  data  collection  effort  Is  complicated  by  the 
fact  that  each  of  the  first  four  Items  are  motivated  by 
several  subjective  evaluations.  As  discussed  In 
Chapter  III,  the  AHP  has  been  determined  as  the  most 
accurate  method  of  converting  subjective  evaluations 
Into  the  numerical  weights  required  for  the  model. 

The  personnel  selected  to  respond  to  the  AHP 
project  survey  were  the  program  element  managers  for 
each  of  the  five  program  elements:  SATKA,  DEW,  KEW, 
SABM,  and  SLKT.  These  Individuals  have  the  most 
project  management  experience  and  are  assximed  to  be 
best  suited  to  make  reliable  pairwise  comparisons  of 
the  projects,  as  discussed  in  the  last  chapter.  They 
continually  report  on  and  monitor  the  progress  of  all 
projects  in  their  respective  program  elements,  giving 
them  a  sufficiently  broad  perspective.  Program  element 
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managers  are  not  likely  to  be  prejudiced  towards  one 
particular  project,  as  a  project  manager  or  research 
scientist  might.  They  also  have  extensive  technical 
backgroxinds  in  their  particular  fields,  giving  them  the 
expertise  to  make  precise  comparative  Judgments. 

The  project  survey  requested  the  program  element 
managers  to  estimate  the  minimum  and  maximum  funding 
levels  for  each  major  project.  Additionally,  the 
questionnaire  required  respondents  to  make  subjective 
comparisons  between  each  program  element  project 
regarding  each  of  the  following  factors: 

1)  Potential  contribution  to  SDI  long  range  goal 

2)  Potential  contribution  to  SDI  short  range  goal 

3)  Potential  generation  of  spinoff  technology 

4)  Technological  risk 

5)  Milestone  risk 

6)  Ultimate  project  success  time 

7 )  FSED  contribution  time 

8)  Concepts  and  designs  balance 

9)  Signature  requirements/data  collection  balance 

10) Functlon  performance  balance 

11  )Technologlcal  base  balance 

The  survey  was  designed  according  to  the 
principles  of  AHP  discussed  In  Chapter  IV.  The  program 
managers  compared  each  major  program  with  all  the  other 
programs  In  that  same  program  element  on  the  basis  of 
the  factors  shown  above.  Respondents  were  briefed  In 
person  and  In  writing  on  the  AHP  comparison  scale,  and 
a  definition  of  each  comparison  factor  was  provided. 
The  program  element  managers  were  given  over  two  months 
(18  Dec  86  -  28  Feb  87)  to  work  on  and  complete  the 

survey . 


MAJOR  PROJECT  SURVEY 


¥PD: 


POC: 


This  survey  Is  designed  to  obtain  pairwise 
comparison  data  on  all  of  the  WPDs  In  your  program 
element.  The  projects  will  be  compared  on  the  basis  of 
eleven  key  Issues.  You  have  already  been  briefed  on 
the  purpose  erf  this  survey  and  It's  theoretical 
f  oxindat  Ions . 

Please  use  the  following  numerical  scale  to  help 
describe  the  relationships  of  the  WPDs  on  the  following 
pages : 


1  -  same /equal 

3  -  moderate 

4  2,  4,  6,  8 

5  -  strong 

7  -  very  strong 

8 

9  -  extremely  strong 


Intermediate 

values 


Please  also  ensure  that  you  circle  either 
"advantage"  or  "disadvantage"  when  each  comparison  Is 
made.  Questions  made  be  directed  to  MAJ  Donnellon, 
USASDC  Program  Analysis  and  Evaluation  Directorate,  or 
CPT  Anderson,  Naval  Postgraduate  School. 


Definition : 
technological 
system . 

In  regards  to 

_  gives 

_  gives 

_  gives 

_  gives 

_  gives 

_  gives 

_  gives 


Potential  for  benefiting  the  overall 
goals  of  the  SDI  or  strategic  defensive 

the  above  comparison, 

a.  _  advantage/ disadvantage  over _ . 

a  _  advantage/ disadvantage  over _ . 

a  _  advantage/ disadvantage  over _ . 

a  _  advantage/ disadvantage  over _ . 

a  _  advantage /disadvantage  over _ . 

a  _  advantage/disadvantage  over _ . 

a  _  advantage/ disadvantage  over _ . 


Comparison  2;  Potential  contribution  to  FSED  decision 

Definition:  Pot 

decision  not  lat 

In  regards  to  th 

_  gives  a 

_  gives  a 

_  gives  a 

_  gives  a 

_  gives  a 

_  gives  a 

_  gives  a 


Comparison  3: 

tF?rhinyiT5ir7 - 


ential  for 
er  than  1995 

e  above  comp 

advantag 

adv 

an  tag 

adv 

antag 

adv 

antag 

adv 

antag 

adv 

antag 

_  adv 

antag 

m 

spinoff 


.Potential  benefit  to  the  generation  of 
military  technology;  assistance  to  the  military  in  ways 
external  to  the  SDI  R&D  program.  mx x j.  1.011  jr  xu  ways. 

In  regards  to  the  above  comparison, 

_  gives  a  _  advantage/disadvantage  over _ . 

_  gives  a  _  advantage/disadvantage  over _ . 

_  gives  a  _  advantage/disadvantage  over _ . 

_  gives  a  _  advantage/ disadvantage  over _ . 

_  gives  a  _  advantage/disadvantage  over 


••j 


'M 


5*^ 


1 


Ml 


^1 


gives  a 
gives  a 


advantage/ disadvantage  over_ 
advantage/ disadvantage  over 


Comparison  4:  Technological  risk 


Definition:  Likelihood  of  falling  to  meet  the  ultimate 
technical  objectives  of  the  program/¥PD;  probability  of 
not  achieving  technological  success. 


In  regards  to  the  above  comparison. 


gives  a 
gives  a 
gives  a 
gives  a 
gives  a 
gives  a 
gives  a 


advantage/ disadvantage  over_ 
advantage/ disadvantage  over_ 
advantage/ disadvantage  over_ 
advantage/disadvantage  over, 
advantage/ disadvantage  over, 
advantage/disadvantage  over, 
advantage/disadvantage  over 


Comparison  5:  Milestone  risk 


Definition:  Likelihood  of  falling  to  meet  the 
milestone  schedule  needed  for  an  FSED  decision  In  1995: 
probability  of  not  achieving  the  milestones  specified 
by  the  WPD. 


In  regards  to  the  above  comparison, 


gives  a 
gives  a 
gives  a 
gives  a 
gives  a 
gives  a 
gives  a 


advantage/disadvantage  over, 
advantage/disadvantage  over, 
advantage/disadvantage  over, 
advantage/disadvantage  over, 
advantage/disadvantage  over, 
advantage/ disadvantage  over, 
advantage/disadvantage  over 


Comparison 


Ime  required 


achieve  ultimate 


Definition:  Time  needed  to  achieve  the  ultimate 
technical  objectives  of  the  WPD,  provided  that  all 
resources  needed  (money,  facilities,  etc.)  are  made 
available. 


In  regards  to  the  above  comparison, 

_  gives  a  _  advantage/ disadvantage  over _ . 

_  gives  a  advantage/disadvantage  over _ . 

_  gives  a  advantage/disadvantage  over _ . 

_  gives  a  _  advantage/ dl sadvantage  over _ . 

_  gives  a  _  advantage/ disadvantage  over _ . 

_  gives  a  _  advantage/ disadvantage  over _ . 

_  gives  a  _  advantage/ disadvantage  over _ . 

Comparison  7;  Time  required  to  achieve  objective 
peqnirgd~fOT~FSED  dg^i?i7n~iTr~i  9  9 5t - ^ - 

Definition:  Time  needed  to  achieve  only  those 

objectives  needed  In  order  to  make  an  Informed  FSED 
decision  by  1995. 

In  regards  to  the  above  comparison, 

_  gives  a  _  advantage/ disadvantage  over _ . 

_  gives  a  _  advantage/ disadvantage  over _ . 

_  gives  a  _  advantage/ disadvantage  over _ . 

_  gives  a  _  advantage/ disadvantage  over _ . 

_  gives  a  advantage/disadvantage  over _ . 

_  gives  a  _  advantage/ disadvantage  over _ . 

_  gives  a  advantage/disadvantage  over _ . 


Comparison  8;  Concepts  and  designs  balance 

Definition:  Propensity  of  the  project  to  be  in  the 

concepts  and  designs  developmental  phase. 

In  regards  to  the  above  comparison, 

_  gives  a  _  advantage/disadvantage  over _  . 

_  gives  a  _  advantage/disadvantage  over _ . 

_  gives  a  _  advantage/ disadvantage  over _ . 

_  gives  a  _  advantage/ disadvantage  over _ . 

_  gives  a  _  advantage/disadvantage  over _ . 

_  gives  a  _  advantage/disadvantage  over _ . 

_  gives  a  _  advantage/disadvantage  over _ . 


Definition:  Propensity  of  the  project  to  be  in  the 

signature  requirements/ data  collection  developmental 


signature  requirements/ data 
phase . 


In  regards  to  the  above  comparison, 

_  gives  a  advantage/disadvantage  over_ 

_ gives  a  _  advantage/disadvantage  over_ 

_  gives  a  _  advantage/ di sadvantage  over_ 

_  gives  a  advantage/disadvantage  over_ 

_  gives  a  _  advantage/ disadvantage  over_ 

_  gives  a  advantage/disadvantage  over_ 

_  gives  a  advantage/disadvantage  over_ 


Comparison  10:  Function  performance  balance 

Definition:  Propensity  of  the  project  to  be 

function  performance  developmental  phase. 

In  regards  to  the  above  comparison, 

_  gives  a  _  advantage/disadvantage  over_ 

_  gives  a  _  advantage/ disadvantage  over_ 

_  gives  a  _  advantage/disadvantage  over_ 

_  gives  a  _  advantage/disadvantage  over_ 

_  gives  a  _  advantage/disadvantage  over_ 

_  gives  a  _  advantage/ di sadvantage  over_ 

_  gives  a  _  advantage/ di sadvantage  over_ 


in  the 


Comparison  11:  Technolofflcal  base  balance 


Definition:  Propensity  of  the  project  to  be  in  the 

technological  base  developmental  phase. 

In  regards  to  the  above  comparison, 

_  gives  a  _  advantage/di  sadvantage  over _ . 

_  gives  a  _  advantage/disadvantage  over _ . 

_  gives  a  _  advantage/dl sadvantage  over _ . 


gi  ves  a  _  advantage/ disadvantage  over_ 

gives  a  _  advantage/ disadvantage  over_ 

gives  a  _  advantage/disadvantage  over_ 

gives  a  _  advantage/ disadvantage  over_ 


This  completes  the  survey.  Thank  you  for  your  time. 

Please  return,  using  the  pre-addressed  envelope  that 
has  been  provided,  to: 


CPT  Steven  M.  Anderson 
1242  Spruance  Road 
Monterey,  CA  93940 
NPS  phone:  T AV )  878-2786 

UOMM)  408-646-2786 


«  -  • 

‘ji  r>  \j\  ' 


APPENDIX  D 
AHP  SOFTWARE  SUPPORT 

This  appendix  is  Intended  to  provide  information  on 
the  software  that  was  written  in  order  to  support  the 
GP  Model  and  perform  the  AHP  process,  a  tedious 
procedure  if  performed  by  hand. 

Once  the  project  surveys  had  been  collected,  the 
next  step  was  to  utilize  the  AHP  to  determine  the 
required  coefficient  weights  for  the  GP  model.  The 
calculations  required  to  Implement  the  AHP  are  numerous 
and  difficult.  APL  [Ref.  38]  was  the  computer  language 
chosen  to  perform  the  AHP  calculations,  since  APL  is 
particularly  powerful  when  performing  linear  algebra 
computations;  APL  has  the  capability  to  directly 
manipulate  aggregates  of  data  in  the  form  of  arrays  or 
matrices . 

An  APL  workspace  called  "AHP”  was  written, 
consisting  of  nine  APL  functions  that  perform  the  AHP 
mathematical  procedure  outlined  in  Chapter  IV.  The 
workspace  was  written  on  an  IBM  Personal  Computer  using 
APL  Plus  Version  5.0,  Statistical  Graphics  Corporation. 
The  workspace  was  Intended  to  be  easy  to  use  and  have  a 
broad  range  of  applicability,  and  is  printed  out  in  Its 
entirety  at  the  end  of  this  appendix.  All  programs 
were  generalized,  so  that  the  AHP  can  be  used  on  any 
subjective  data  array,  not  Just  the  USASDC  data  set 
presented  here.  The  programs  were  also  designed  to  be 
interactive,  so  that  a  user  Is  prompted  for  the 
information  needed  at  the  appropriate  time,  a  feature 
that  helps  avoid  confusion  and  needless  repetition. 
The  programs  are  also  relatively  fast,  so  that  changes 
In  the  data  can  be  made  and  analyzed  quickly,  a  needed 
characteristic  for  sensitivity  analyses.  Additionally, 


the  fxmctlon  DESCRIBE  gives  the  utilizer  an  overview  of 
the  workspace  and  the  functions  contained  within,  and 
INPUTHOW  Is  a  function  created  to  demonstrate  the 
proper  method  for  entering  pairwise  comparison  data 
into  the  other  routines. 

The  workspace  has  several  key  subroutines  that 
serve  as  building  blocks  for  the  other  routines.  The 
main  function  AHP  utilizes  four  APL  functions.  MATRIX 
takes  given  pairwise  comparison  data  and  manipulates  it 
into  the  matrix  needed  by  the  other  workspace 
fvmctlons.  Additionally,  this  matrix  Is  printed  on  the 
terminal  screen  so  that  the  user  can  verify  that  the 
correct  data  was  entered  Into  the  routine.  EIGENVECTOR 
performs  the  linear  algebra  calculations  in  order  to 
produce  an  eigenvector  of  ratio  scale  coefficient 
weights.  Consistency  Index  (Cl)  and  Consistency  Ratio 
( CR )  values  are  also  calculated  and  displayed  by  the 
EIGENVECTOR  program.  AHPBASE  collects  all  the 
eigenvectors  calculated  from  comparison  matrices  at 
each  particular  hierarchical  level  and  for  each  factor. 
AHPSTAND  determines  the  overall  standardized 
eigenvector  for  the  main  factor  (le,  payoff,  risk, 
time,  or  balance)  being  analyzed  based  on  the  AHPBASE 
eigenvectors  at  each  hierarchical  level.  For  example, 
AHPSTAND  made  one  overall  standardized  eigenvector  for 
risk  from  the  milestone  risk  and  technological  risk 
arrays.  The  main  workspace  function,  AHP,  serves 
principally  to  call  up  these  subroutines  the  correct 
number  of  times  and  formats  the  output. 

Two  additional  functions  are  included  in  the 
workspace  that  are  noteworthy.  SINGLE  Is  a  function 
designed  to  perform  the  AHP  procedure  when  only  one 
comparison  matrix  Is  being  studied.  AHPCHECK  allows 
the  user  to  ensure  that  the  AHP  Is  functioning 


correctly.  It  is  identical  to  the  AHP  function,  except 
that  it  prints  the  computations  made  at  each  step, 
enabling  the  user  can  check  for  accuracy  and  logic. 

A  summary  of  the  functions  contained  in  this 
workspace  Is  shown  below: 

1.  INPUTHOW  -  Recommended  reading  for  the  first  time 
user;  demonstrates  how  to  enter  matrix  data. 

2.  AHP  -  Determines  a  weight  eigenvector  for  several 
factors  at  various  hierarchical  levels. 

3.  AHPCHECK  -  A  checking  function  to  ensure  that  AHP 
is  calculating  eigenvalues  and  CRs  properly. 

4.  AHPSTAND  (subroutine)  -  Determines  standardized 
weight  eigenvector  for  elements  In  comparison 
matrix . 

5.  AHPBASE  (subroutine)  -  Collects  basic  comparison 
matrix  data  for  AHPSTAND  subroutine. 

6.  SINGLE  -  Computes  a  weight  eigenvector  for 
elements  In  a  single  comparison  matrix. 

7.  EIGENVECTOR  (subroutine)  -  Ascertains  matrix 
eigenvector  and  calculates  consistency  ratio  data. 

8.  MATRIX  (subroutine)  -  Creates  matrix  from  input 
values  for  use  by  eigenvector. 

The  completed  surveys  were  converted  Into  data 
arrays  and  entered  Into  the  AHP  function  as  input.  The 
AHP  program  was  used  four  times,  once  for  each  factor. 
The  comparison  matrices,  their  respective  CIs  and  CRs, 
as  well  as  the  intermediate  and  final  eigenvector  for 
each  factor  was  printed  In  an  output  file  (see  Appendix 
F).  This  concluded  the  procedure  for  determining 
weight  values  for  each  project  in  regards  to  payoff, 
risk,  time,  and  balance. 


t 

f 

I 


a; 


b) 

CO 

bj 

Q? 

O 


« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

* 

* 

* 

* 

« 

« 

* 

* 

* 

* 

* 

« 

« 

« 

« 

« 

* 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

« 

* 

« 

« 

« 

« 

« 

* 

« 

« 

« 

« 

« 

a  a  a  a 


cs 


&4 

■5S 


a; 


2: 

o 

CJ 

a: 

a> 

b4 


CO 

BQ 

►4  Cj  O 

I  H  COl^ 

B<o  Csa:  i^a! 

OjCi  H6<<  •«<Eh 

coo  a*  s  o«ta;,  , 
H:ab)o  %  H  OblO 
ft!  Eh  •  b)ft3  *€^0;% 
EsbaK^COt-SbiajCjQCjxtH 
a::aHb]Ox«a;b]b] 
:ft6stHcoa>  iqtEsr^coa; 

H  es'<<^%coa;b);ft%Eq 
a^kqcokjQsEsbakqbiOO 
00  OHO  O^HOCiH:^ 

O)  ft]  fty^h^CqftjSHEsO 

tH  OCObQftiH  s;  Obl^tCj 

HOa;HHI4b)i4Cj  o 

•«i:oH  Hasoa;  e^oco 

HH  EftOEsEoHCOHCjEft 
OH  OO  HOHO 
OCj  .  HObJH  0««H 
m  OOC0C0a;HC0««&4HCjC0 
OCOEsO  b]  ftjCO  O 
OHbio  ^aic^^  HH  • 
o  cjBaa-HHO  “tcjcjo 

••  Hosoaio*?:  Hbi  oo«t 
b]  eHb]ft;b)>^  ••Ha;Hb]oa; 
oa:a,H  cocoHOHOCS 
blHbjHH  CO  O 
OOH  tSi.OXOOHO05 
h«  ft3CocjHbib)b)b]Co«3:a4 

OCjohhs;  asHoa; 
HasooasHbicooooobi 
OH«i:a:oa;Ha;  bio  ai 
■t  ft;b]a;"tBaO  *<0  OH 
HC0b]O«clXi  HHOHH 
ft;b]Hoa;%HCjHa;'4  O 
ocoa30b]00'^b]a4a:ft:H 
HO  HCjKiiHHHHHO 
O  ooa:  s;  «?a;  coH 

HOHN  CO  b30  b]0 

OHHbi^HajHCOH  H 
HHHHSajOHHHOHO 
coHH-t-t  H  OgoH 
OO«q;OC0Q:C0b,O«t  HO 
OOO*^  biOO  HO  H 
0«5C  bjcoo  «<Hbj 
biH  OaiOCOCO  *0  HO 
a:  biHH  HHO  HOO 
HHa:  b]a;cob]00*tH 

asHcoHas-^KCcobix^Ob) 
co«^  H«<HHa3>iOHbjna 
H  b3  s:  HOO 
bjHcocoHObj»eeHoa!*»; 
CO  coa!OcoQ3«5;cja:OHHOH 
HHObioa!  H«j:oa:H*»: 
ft!  CqCjHHO  onajo 
H  XOCJ  OOOO  O 
•bjO'^OHOO  I  O  H 
b3  HHbiH  Hbjco  *0 
••CjO  OOObaHHO 
b)<q(HC0HOb]b]mo*i;b]>i 

COH  H«<cocoa;  o  OH 
ocobjft!o:cobj«):H«tcoHH 
HOCjHb]>q;ft;Hb]  HHH 
::k  HOa^b]  O^ 
OOHHbgCOHOHftiHHO 
HOCOOCOHHOHHHHCar 


O 

o 

CO 

b) 

Q 

O 


*  -  b3  o  CO 

«H  a;  «?;  -  a; 
«a3  H  a:  H  p 

*  Cj-  o  bj  H 

« 000-0  o 

««<OHHO-b)  ba 

*  a;«tHOH  ‘H  ^ 

«b]C0OO  a;  o 

«H  b)baH  ba 

•KObiObaooxt  O 
«  0«<a;EHHCj  H 

*  cjHH«t  aaH  ba 

«H  H  OOO 
«HHHOHHCj  ba 
« H-^OOO  a;  H 

*  H  ■tHHH«t  «« 

««c:coH  oa;  h 

«OH  Ha^KiCO  O 

•le  k^OCOHH  H  Cj 

*  ban  “too  H 

«bao_  OO.  ^ 
«a3baa;  •  ho  O 

« EsHbacoxoo 
«  OCObaHOH  o 

*0  OCJOH  H 
«00  HHHH 

«0b3b>0“i;00  o 

•icHaaoHSio  CO 
«ft;«t6>(«t  OO-  H 
« baH  OO  H  ••  O 

«HOH  OOH^ 

*  O-tOHOHCO  O 
«t400000Hba  o 
« H  HCObaH'HJi  H 
« HH  HHOOH 

« oooaaoaaoo  co 

«  •tb3“tbi  "ta;  o 
*0S0H  OOH  p- 
«0  OOHO  CO  H« 
« HQCOOOObaO  OH 
« HOCOO  HOH  *tba 
« 0“t“i:  HOH*t  HH 
« O  0«tH  ba 

*  OCOCOHOOOO  HH 
*Ha;H  HOH  P 

*  o  oa:  H  H 
«coHHbabiOOba  o*t 

*  HOHHHObaco  bao 

•icO“t  OOHHO  OH 
«HH  oaaHOH  OO 
«  «a;HOOO  OO 
«  HHO  O  O  oa; 
«  baOHba 

«Ha;a^KtOHm'-^  bao 

«ft!babaHH  Oba 

« baOO  HH 

*  ba  oooHba  O 
«ocoH  HHON  a; 
■acH  “tCoH  OH  OCO 

*  oo^tObaaaH  hh 
« baoHO  ba  “taoo 
«0  O  ocoOO't’baH 


o 

ba 

s».  O 
ba  ba 


o 

o 

o 

ba 

ba 

ba 

ba 

a; 

a; 

bk. 

o 

o 

O 

o 

o 

H 

p 

H 

o 

o 

-► 

H 

aa 

o 

esOri 

-► 

-►4  4  0tM 

OT^OtHOT-lOO  I  + 


o 

ba 

bi. 

H 


«OCOOO«t  co^tba  _  _  _ 

«Ocoa;OHO>9;  HbaH  4’ -f -f 'f  4’babaoo 

«kaba“t“tHcobaOH(0“t  oooooobk^babaorH 
«baoa;  H“tHOH>t  b3bababababab3baft>£^  4  4 
« aftObaHObaHHHbao  a^b^b-a^HEi^babaoajoo 
«  OHO“tH  ba0H0a00baba00a;Q;00bab3 
«  HO“«HH  BaHHH4HHOOOOpOpp^H 

*-------  -  na-  -  xoaaooHHHHHHHH 

aaaaaaaaaaaaaaaaa 


T  I 


r-r-t-r-i  ■»  'ir  ■'  ■■lOTiCMtn  J- into  00  OTOr-ICVCn  J-tntD  t**  00  C7)OTHCNCn  a' tntOr^  00  (310  CM  CO  j-tn 

CM  c*)  3- m  CO  P' 00  CJ)  th  1-t  th  Ti  t-i  th  th  »-t  CM  CN  WCM  o»  CN  CM  ?>«  CM  nj  CO  n  cn  cn  cn  cn  n  (o  CO  d"  d- S’ d- 


Cq 

•►H 


X 

tqo 

CitH 
H  + 
03  CJ 
^Ba 


r4iqN(nC<4N:^ 

Qk3:^wi^k^Gg 

•ccEsXOjiqirmb] -f 

^cov  cU:^  II  II  K^o 


Eq 

Sik 

Eq 
Bq 
03 
XO] 
^  ♦fs 
X^+ 
f  OEJ 
O^ftaiq 
EqO£^3^ 
:i.Cq'^Ci 

HCinjEs 
Q3H-»-  + 
-*-03N^ 
N-4-Otig 
♦  N  +  Sk 

CjwObJ 
Bi'f  Ba:^ 

fc»cjs*o 

C:)EqBa<^ 

Nfc»B3tJ 


o 

b) 

§ 

§ 

+ 

§ 

o; 

X  03 
•►X6S 
X  '^•►  + 
•►  Cy-'O 
B]0B3 
iqc.'  fc»cqs» 
i»CqCjCiEi.O 
OEkBaH^:^ 
HOO>.  tones 
tOHO-<-Q3  + 
•»-CQnN-)>0 
Ns- 03^^63 
+  N-»-'f'-^ 
0'-^O  +  &3 
B3+  +B30^ 
Ei0tj::^B30- 
CdEqblEqSk 
n^is>CqQ;Cj 


T- -vj  V  II  M 

0>q;  to  xC^EqXXOtaqd- 10003  B3;ttQOUCt:03Eq< 
+  ••Or-'  +  ••i4na;oE^  •> 

•qrt-iK^  +  NO  f  +  nes  +  cseseses  +  tn6s(Oesiq6s:3 


mm  w 

»  •• 

«  « 

«  « 

«  * 

«  « 

«  « 

«  « 

*  ♦ 

■K  * 

«  « 

*  « 

«  « 

«  « 

«  « 

«  « 

«  « 

«  « 

«  « 

*  * 

«  « 

«  « 

«  « 

«  « 

«  « 

*  * 

«  « 

*  # 

«  « 

«  « 

«  « 

«  « 

«  « 

«  « 

«  « 

«  « 

«  « 

«  « 

«  « 

«  * 

«  « 

*  * 

«  « 

«  « 

«  « 

«  « 

«  « 

«  « 

*  « 

*  * 

«  « 

•• 

«  * 

/■^ 

«  « 

■5! 

«  « 

Bq 

♦  -je 

«  « 

n 

«  * 

es 

*  « 

es 

«  « 

«  « 

n 

•4C  * 

«  « 

es 

*  * 

*  * 

0 

«  « 

o 

«  « 

n 

*  -je 

«  « 

CQ 

*  * 

«  « 

«  « 

«  « 

* 

*  * 

04 

«  « 

«  « 

«  « 

«  « 

03 

«  « 

•• 

•»e  -je 

«  * 

n 

«  * 

"< 

*  * 

B3 

«  * 

«  « 

(:>. 

«  « 

«  « 

Bq 

«  « 

«  « 

n 

«  « 

*  * 

«  « 

«  « 

n 

«  « 

«  « 

■5C 

*  * 

■j: 

«  « 

0 

*  * 

«  * 

H 

«  « 

«  « 

03 

«  « 

«  « 

0 

«  « 

H 

*  * 

03 

*  * 

«  « 

«  •* 

0* 

*  * 

03 

«  « 

■4C  « 

Eq 

«  « 

*  * 

H 

«  « 

*  * 

0: 

•4C  « 

*  * 

«  * 

*  * 

«  * 

*  « 

«  « 

«  « 

«  « 

«  « 

•H  * 

«  « 

*  * 

«  « 

*  * 

«  « 

*  * 

*  * 

«  « 

*  * 

«  * 

*  * 

«  «- 

•• 

«  *- 

■» 

«  « 

«  « 

*  « 

«  « 

01 

•1 

1 

COI 

Hi 

N 

C3I 

X 

ba 

CM 

» 

%i 

Bqi 

fiqi 

1 

0 

m 

ca 

B31 

01 

1 

iEdI 

|>3I 

ca 

03 

* 

■Q 

1 

toi 

1 

1 

1  1 

1 

toi 

•• 

1 

EmI 

to 

03 

;%l 

03 

ta 

B3I 

p 

esi 

% 

Ss 

tji 

iqi 

0 

Bqi 

HI 

?! 

EX 

Bqi 

iq 

1 

Eqi 

03 

Bq 

cqi 

ca 

0 

m 

EhI 

Bqi 

ca 

?5 

1 

Bea 

B3 

ca 

EX 

03 

Bqi 

Nl 

bJ 

HI 

ca 

% 

C3i 

1 

03 

EQ 

«« 

ca 

C3 

era 

!%l 

1 

■qj 

1 1 

esi 

1 

toi 

XI 

ca 

ha 

03 

ca 

o 

Bq 

Ek. 

es 

» 

tn- 

in 


r^’  *  7^*  ■  ■  ■  »-‘^-»  ■  »■■»  ■»■■  ir  »— r- »  I  »  »  ■"»— «  Hill  »-»■  »■■■-»  ■  ■  ■  I  I  r-i  »  ■  i 

(O  rv  CO  o)  o  T-i  CM  CO  :t  in  (O  ro  00  cn  o  rs  04  cn  :3- in  lo  (>.  00  o>  o  T-t  CM  CO  ^  in  (O  r^  00  a>  o  ri  CM  cn  :3- in  (D  t>.  CO  C7> 
It  S’  3■^lnln^nlnln^nlnlnlnlnlDvOl0^o^o^o^OlOlO^D^^^*o•p^r'*^»^»^»^»^*oooooooooooooooooooo 

i«l«  «-«««■■■  >.J.».JI  ,Jt,.X,>_l  I  ■  ■  ■  -  ■ 


112 


iiDaAi/+)it  ti  9)* I  =  tins 


FUNCTION i  AHPCHECK 


* 

«  00 

*  o> 

«  Q4  t-l 

*  a: 

*  "5 

* 

*  •• 

«  b]  in 

*  CM 

*  ?! 

•*  ^ 

«  to 

«  bi  EO 

*  a:  &H 

«  C)  •?c 

«  14  Q 


bQQ 

aeb] 

6<|C0 

o 

CO 

«<bj 

Q) 

Co 

b::%Q: 
to«!j:o 
?!Cj6h 
6s  tj 

a:bi 

blOSik 

S:h 

"ta:Q 

co:%% 

b]6s 

asa^co 

6^04% 

siajM 

a;o6s 

O  «3! 
b^i^es 
teK^o 


HO 

OHO 

I^H 

000 

:feOH 
bj'^co 
6h  «i; 
febJOJ 
HO 
HbS 
tofe.0 
HObJ 

:soo 

S 

Q-OO 
OS;  6s 

9"*! 

55^  ®! 

OOb] 

a::^ 

to*acS  • 
H  «5C0 

a;sa:a; 
6s -^OO 
ftJOH 
OOH 

••00*^ 

bjo;  o 
coObiO 
O  a;0 
Oa:6sH 
a;H 

o«cH"»: 

osos; 


aaaaaaaaaaec 


*-  O  a: 
*0  bj  o 

*  H  6s 

*co-  bj  o 

•fcxtHO  bj 
<oaj  5k 

«b):^«q:  b] 
*a;HO  O 
*6sOH  H 
«  b}a:  b] 
*bSCjO 

*0  a;  bj 

scbjbjiq;  6s 
■ica;toa; 

■*:0«tbj  1*3 

•«  biH  O 

*ooaj  o 
ssSsa,  1^ 

*  to  ■< 
*0  H  O 
«bj  -as 

*o:^6s  o 

«^0  6s 
*biH6s 

*  6s6s^  a; 
■<52:0  to 
*H:^to  H 

*  oa;  :» 

*t0b4O 
■«H  6s  O 
«  00  O 
«!ca:««  H 

•KitJIoHb, 

sea:  to 

«o:^0  a; 

■itOHbi  o- 
*a:«xsft  6s  •• 

«oa:H  00 

«  Q)  K^liO 
«cob]:^  b.Sk 
scHasO  Cq 
«a:6sO  h4k3 
■K6s  O 

*  :^bi  iq 
«  Haj  D;*?; 

6s  bJO 
«b;0  OH 
« Obib, 
*b]Sko  ao 
«a:o  ifto; 

«OObi 
«05k.tq  {qo; 

stores  a:bj 
•*“?HH  6sH 
«  6s  O 

«oco  a; 
*6s%b}  bjto 
«  oas  6sH 
«haHesa:%a: 
«:S6s  +06s 

*  O'^Obj 


«a;iq  aa;  O  x 

*  OObj  bj  s» 

«05k.kq  {qo; 

■•ta:^6s  a:b3  aa  a 

■hisjIHH  6sH  O  O  O  bj  bj 

'K6sa:b]b]EqQ;  5k 

5k  fck  a  ><o 

*6s:^b}  bjto  O  Eq  O  6s  ♦H 

«  Oaj  6sH  H  ^  -►  O 

*OH6sajsa:  o  O  6sOrs  o  o^ 

^  ■*■  ■*■'•’■♦’  rSbjNCS 

■«0*«:0bj  OrSOrSOTSOO  6s  OOSk^^ 
•*  06s^‘qbi6s  +  +  +  +  +  •ftabj  -► 

*HOH6stO«5i!  OtjC)GOOfck5»Ors 

■“  bjbjobjblbjbio -f  +  "CesXObJtn 

« a%;9:6sb3Q:  5k5k5.5k5k5ktqb300  +tOVQa>.|| 

*  p6s0H0O00b)b300asa;b3bjo'<caji5fkxbjs>< 

*  OcoHa4b«  +  HH^^a:ia:a:tktk+ «cc'^  +  S'5 

« - a-  -  X00006s6s6s6s6s6s«?:rs«i:f  NO-f 

a  O 


11 

B 

B 

B 

+ 

X 

II 

+ 

•►o 

II 

+ 

in 

in 

in 

B 

r 

O-Nfej 

II 

+ 

> 

os>. 

II 

+ 

r-*. 

rs. 

in 

t 

Coo 

II 

-► 

Ni^ 

i 

II 

+ 

m 

« 

«k 

r% 

k 

o&< 

II 

-► 

* 

Ni^ 

, 

H  + 

II 

-► 

•• 

•• 

«• 

• 

t 

(DO 

II 

+ 

% 

k 

-►to 

II 

+ 

a 

a 

S 

•• 

1 

II 

+ 

CO 

CO 

II 

+- 

o 

t 

II 

+o 

o 

o 

Cj 

CO 

OC5 

II 

+  toOto- 

Oto- 

Otiq- 

SkCj-  II 

otl  11- 

II M 


-  » 

O  lo 
ct; 

Q 


«^CjCJ 

CitijCio 

%OCQ&| 


+  w  I  '^O  Ci6iJ<^0  - 

+  "  •  •  r>'  I  li]  •ftj  •>  •  .» 

+  -  -  -  wiQ;_t^  ;fcO«>6s  -  “  15  '-' 

+  ••  ••  ••  •  I  O  ••Ci"”  •'^-►+  ••  ••  is  « 

+  g  g  5  -  Ilk,  ana  seqnjcj  s  cq  - 

+  ^  ^  ^  ••  I  b)  ^oaU]  :^-«-wcg  ^  .. 

+  «o  «o  <0  a  I  oj  «o-*-a  toNj+tk  CO  «oo  o  :e 

+  -  a  I  N  wCjbj-  -  bjcjbj  a 

+  tj  Cj  o  Cj  W  I  CJ  0  +  0  O  +  bJfeO  OO  OSkCoSk  CO 

+  &30&a-  O&a-  Oki-  i  toOC«O60Ot*3O:^OEtiOi»3t>3Ot*3i»3a>.b3- 

•»-&kb]:^Cjb3£^OC4C^O  O  1  ::kEa:^(i3>.t4C^b3b]  +  ^b3&k:^b3&k.b]b]EcCj  O 
+  o&».o&jt^&3Cti:^c»feiObi  I  o::^oa*oSkOakbjoi*3:^i*3o:s.OQ:t«3Q;t»30b3o 
+HOHa>.63ies.o:i&,(*)S»cr>-  HO*-iOMONoo;baac«3aaoaaQ:a&>c«3>.  + 
+aHoj^Hiftac<;a&iEs>6Hk^  ••ooHPQHOQHtsiaatkoao&iaesEHaeiEHSkEs  •• 


- -  (Q»  _  Qj-  »  6^»  «  ^  c^_  oj-  a-  OJ-  SsEhEh-  O-  -  Eh-  -  6i-  -  6^-  crj 


00  o)  o  ri  (n  ;*■  ir>  ID  r»  00  C7>  o  <N  cn  S' m  VO  tx  00  C7»  o  T-i  es  tn  d"  m  VO  00  o)  o  T-i  CN  m  :j- m  to  fv  00  (3>  o 
cncDcns  S'  s  s  s  S'  s  s  s  smvr>invnvninvr)invnvnvovovovovovovovovovor^r>-0'»r''«C'>rvr'.C'«f'>r^oo 


‘•,»‘*n‘.» 


« 

« 

« 

« 

« 

« 

II 

II 

« 

« 

« 

II 

II 

« 

Ei 

« 

II 

II 

« 

« 

a*  a; 

« 

II 

II 

« 

« 

a,  OH 

« 

II 

II 

•• 

« 

« 

coo  EO  a; 

« 

II 

II 

* 

X 

* 

« 

as  %  H  Em 

« 

II 

II 

EO 

H 

« 

« 

:aa;s-^:  Em  eo 

« 

II 

II 

H 

?! 

* 

« 

HO*5C0;  H 

« 

II 

II 

a: 

Em 

* 

« 

HEMOsEi  H  «;< 

« 

II 

n 

Em 

■t 

* 

« 

oejoo  -^a: 

« 

II 

II 

% 

« 

* 

oasoosHOH^a 

« 

II 

II 

a; 

* 

« 

osr^osHHO  o 

« 

II 

11 

H 

EO 

* 

QS^H  H  Q 

* 

II 

II 

H 

« 

« 

c» 

oas  osKci^i^Kx 

« 

II 

II 

EO 

as 

« 

00 

EOEiEOOaasEOEM 

* 

II 

II 

Em 

Em 

* 

« 

at 

HH  OEmO*'? 

« 

II 

II 

a: 

• 

* 

« 

a< 

tH 

cssasasEoH  o 

« 

II 

II 

as 

a 

•• 

« 

* 

a: 

as  EmEmEmi^^ 

« 

II 

M 

% 

H 

X 

« 

* 

•s: 

% 

aso  :^H%asas 

« 

II 

II 

as 

H 

« 

« 

Has  asoHasEM 

« 

II 

II 

H 

CS 

a 

« 

« 

ON  •3:csa;a«5< 

« 

II 

II 

ba 

as 

Em 

« 

« 

•• 

Hxas^oea;  h 

« 

ii'^ii 

as 

a; 

S 

« 

« 

cn 

bscsHH  ao  o 

« 

II X II 

■s; 

% 

« 

* 

C4 

NOjOjas  Ej  'Ej 

« 

11  » II 

as 

H 

* 

h«s;Em  •:axH 

« 

II 

II 

Em 

% 

a 

a< 

HCs«j:EMa;oH«j: 

« 

II  O  II 

o 

a 

a 

EO 

•• 

Ha:s:a:OEja;Ej 

« 

It 

M 

as 

Ej 

Em 

» 

« 

aj 

as 

EM*t  asEM  Em 

« 

II  n 

Em 

« 

a; 

Em 

OEM:aa;Ejo«tH 

* 

ii^ii 

H 

Ei 

a 

o 

« 

C5 

Eooas««as:aH 

« 

II 

«li 

% 

a 

o 

% 

« 

O  EoHa^EM  H 

* 

II 

-  II 

H 

CM 

«< 

« 

H«J!Ha, 

* 

II  a;  II 

cs 

as 

Em 

* 

a; 

« 

asHI^HO 

« 

II  as  II 

as- 

os 

a 

1  *  1 

C) 

« 

c;s:a<<ccsHa>Eo:a 

* 

II  as  II 

Em  •• 

1  1 

o 

« 

asHH  OEjHO 

* 

II  :a  II 

EO 

H 

1  a  1 

a; 

« 

:a«cas>M:aHa;H 

* 

II O  ii 

Has 

Em 

1  a  1 

a^ 

« 

a: 

OEmO^Hx^x^Em 

« 

ii:aii 

tjco 

a 

a 

1  a  1 

« 

Ei 

HasEjxjlCOEjOiEj 

« 

II 

II 

OES 

£3 

■a; 

1  %  1 

* 

EO 

coo  :a  sa; 

* 

II  XII 

EOH 

% 

1  a  1 

o 

* 

a; 

as  as  xqsEooas 

* 

II  H  11 

EOEJ 

as 

o 

1  a  1 

* 

as 

QCSHaq  HEsa* 

* 

Ilia  11 

xi:% 

H 

o 

1  1 

Q 

« 

cs 

a;Eaa;o  ^ 

« 

IIEmM 

as 

as 

a 

1  X  • 

« 

co«j;;a«55EM««EMEo 

« 

ll•q;ll 

as 

■a; 

1  H  1 

Eq 

•K 

■5C 

H  Hfti  EmOH 

« 

11%  II 

%p 

a4 

H 

1  a  > 

a 

a 

« 

ascosicsxcHas 

« 

II 

II 

“SEm 

o 

?! 

1  Em  I 

a 

o 

« 

« 

• 

SEj  oascsa:EM 

* 

II 

II 

a; 

Em 

1  **  1 

Em 

o 

« 

« 

% 

Kjjiqjx^cja;  H 

* 

II 

II 

EO 

?! 

1  %  1 

H 

a 

« 

« 

QsH  mH  • 

« 

II 

II 

a«a3 

as 

a 

1  1 

Em 

o 

« 

« 

ai 

OEo:aoft.Eja3a4 

« 

II 

II 

oas 

os 

a 

1  a  1 

w 

« 

« 

as 

oXHEMSa:a!a: 

« 

II 

II 

OH 

% 

a 

1  O  1 

«k 

m 

« 

« 

EO 

asa;  oasEMx< 

« 

II 

II 

aso 

o 

a 

1  a  1 

* 

* 

as 

HOCSOsCjEm 

* 

II 

II 

Eio; 

a 

o 

1  1 

« 

« 

S? 

Em 

r^asas  coraas 

* 

II 

II 

Eh 

1 1 

« 

Oi 

EO 

EO  :aE0EiHHEM 

« 

II 

II 

asEo 

as 

a 

1  Em  I 

•• 

« 

as 

HEOHOaiEO  H 

* 

II 

II 

aso 

a 

a 

1  ^  1 

a 

•  • 

« 

* 

a;*^«j:  H^cs:a  • 

« 

II 

II 

EmH 

Em 

Em 

1  cs  1 

o 

aa 

« 

* 

•  • 

EMasEMasasoas  eo 

« 

II 

II 

"as 

1  1 

Em 

0"< 

* 

« 

a; 

EM^asosEjassaas 

« 

II 

II 

a 

a 

1  a  > 

Ej 

OEm 

« 

« 

•  • 

as 

oem  asoEj 

♦ 

II 

II 

as 

a 

1  a  1 

"< 

aE3 

« 

« 

S 

••:aEj  dohemhh 

« 

II 

Ii 

EmEO 

Em 

Em 

1  "<  1 

a 

e:>em 

« 

« 

O 

3; 

asH  coosxulaEMO; 

« 

II 

II 

%=> 

a 

a 

Hi 

« 

« 

«< 

CO  EoasxcEjasEjEM 

« 

II 

II 

as>-' 

as 

a 

% 

« 

« 

05 

OQasH  H  o«< 

« 

II 

II 

o 

« 

« 

Ej 

Ei 

a4a:oasEMEM>^H» 

« 

II 

II 

asxaas 

a 

a 

« 

* 

o 

a;OHx««CHEM!a 

* 

II 

M 

EOH  +EO 

a 

+ 

« 

* 

a: 

oox^^asosmoa. 

« 

II 

II 

•q;a;a4*a;o«s: 

o 

« 

* 

a* 

04 

HHSfcasEMEjOEjO 

II 

II  - 

asEsoas'fas  - 

•> 

H 

* 

« 

« 

II 

It 

H"<OH%Ha 

Em 

« 

* 

« 

II 

II 

H%o;ft4aH  + 

«o 

« 

«- 

•  • 

-  -  o-  a 

-  tifc- 

«  •• 

-  a 

a  a 

aaaaaaaaaaaaaaaaa 

1  H  R 

0000 

tH  CN  en  S’ m  U)  00  0>  Ti  ri  tH  ri  rH  t-l  T-t  ri  tN  CN  CN  C't  CN  CM  C'J  CM  CN  CM  CO  cn  00  (T)  CO  (T)  tn  cn  00 

*'Si' 


j 

'tj 


f - 

p 

« 

« 

•It 

■* 

i 

* 

« 

•K 

•it 

■K 

CO 

* 

« 

« 

•it 

■it 

■It 

H“ 

* 

« 

* 

•K 

•K 

■it 

dd- 

K 

« 

« 

« 

•it 

•K 

EnCJd 

1 

« 

« 

b«  ^ 

•K 

•it 

•It 

“td 

1 

« 

« 

coo^H 

* 

•it 

•K 

ddd 

\ 

« 

« 

ba  o 

•K 

•It 

■it 

Eh  Eh 

'1 

« 

« 

feaaHcj 

•it 

•It 

■K 

•  • 

d 

« 

« 

HOEn^bO 

* 

•It 

•It 

d 

dH  • 

« 

« 

EneHCjIfttO 

* 

•It 

■it 

•> 

d 

d  d 

i 

« 

« 

C)Cj:feKi*t 

* 

* 

•  • 

Eh 

dcod 

« 

« 

r  ba^««aa 

* 

•it 

■K 

ha 

Cj 

jjCEhEh 

k 

* 

« 

Cc,5kb4EHa4 

* 

•it 

■It 

N 

■ 

« 

« 

aac;  :%a] 

* 

•it 

■It 

bl 

dd^ 

V 

« 

« 

fk 

abacoQK^ 

■K 

•it 

■It 

d 

1 

« 

« 

00 

COCJHCj 

* 

•It 

■It 

CO 

cjd 

j 

« 

« 

a> 

Has  ba 

« 

•It 

* 

d 

H 

dca 

« 

« 

asbaEncoaa 

■K 

•It 

* 

■5! 

a: 

cjdd 

% 

« 

« 

a: 

ba  EhEh 

•it 

•it 

* 

Eh 

d  Eh 

ft 

« 

* 

:c 

asci 

•K 

•it 

* 

Htn«< 

« 

« 

Enba  ‘baCJ 

* 

•It 

■it 

Eh 

d 

d  Eh 

n 

« 

« 

c3Nx:s:c 

* 

•it 

■It 

Eh 

ddco 

n 

« 

« 

•• 

HHbaH 

* 

■it 

■it 

as 

Eh  I 

n 

« 

« 

b] 

badesiaika 

* 

■It 

CO 

d 

dHd 

1 

« 

« 

Cj 

CH 

xasEnbad 

* 

■it'^-lt 

H 

d 

ddb. 

■ 

« 

« 

H«0S«t  ■< 

* 

•itioe-it 

d 

■?  d 

5 

« 

« 

a^ 

ddSHCj 

* 

*0* 

■< 

coaa 

- 

« 

« 

CO 

•  • 

HC:  ^ 

* 

* 

* 

d 

& 

End^ii 

« 

« 

bS 

Eq 

En'^ftbaH 

* 

*o* 

o 

iqjtj 

<4 

« 

« 

a; 

Eh 

dEnOasd 

* 

* 

■it 

d 

d 

dHd 

j 

« 

o 

cocobjd 

* 

■ItCH-it 

Cj 

Endd 

[i 

« 

:% 

Q 

ca  Hbibq 

* 

♦  w« 

d 

EhEh 

«j 

■< 

« 

Cno^asbiEH 

* 

■it 

•■It 

d 

d 

u 

b] 

cj 

a; 

« 

* 

■it' 

-  * 

►i 

d 

Endbi 

Sk 

bq 

o 

« 

caC;a<dba 

-* 

•itd« 

H 

d  d 

r, 

bk 

o 

« 

ban:^  d 

*  ■ 

•itba-K 

d 

d 

doo 

r, 

a: 

Q 

a: 

« 

fe«5;oHfei 

* 

•KDQ  •« 

Cb 

aa 

d^  CO 

> 

ti 

% 

a^ 

« 

:c 

cj6HCj:%a; 

* 

•«%•« 

ddH- 

H 

« 

ca 

Hd  xj* 

•it 

•icd-it 

Cj 

CO 

HbkCO** 

b} 

Eh 

b, 

* 

CO 

cooba!5H 

* 

•Kfe^lt 

d 

d«t«td 

J 

«0 

o 

« 

a; 

ba  %  d 

•it 

•it 

* 

bl 

Cj 

^  dead 

5  X 

» 

» 

« 

ba 

cidoba 

■it 

•Kd'it 

H 

bl  H 

&  H 

Cl 

« 

Q 

a;  a;co 

* 

•itO'ie 

ba 

dCidEn 

1 

m 

<n 

« 

% 

C0'9;as«<bq 

•it 

•itEnK 

d 

Eh 

1  ^ 

b] 

« 

H  -«dcj 

•It 

♦  O'* 

Eh 

S 

dHEnCO 

5 

in 

m 

« 

baaa^H 

•K 

•*«:?■« 

d 

d  H 

H  % 

« 

« 

* 

^ecjEnoa: 

•it 

•Itd^lt 

bi 

dbidd 

?  o 

• 

«k 

« 

« 

s: 

«^«J!  CjEh 

* 

•it 

* 

d 

bl 

dHdEn 

m 

« 

« 

ddb]  •<« 

* 

■it 

* 

d 

•• 

« 

« 

cjcoaao* 

* 

•it 

* 

ba 

^  o:eh 

<0 

* 

« 

b] 

CJXOEh 

* 

* 

* 

d 

s 

ddxiS 

^  inoaj 

•• 

Eh 

* 

« 

> 

asd:?  Eh 

* 

* 

* 

■< 

d 

HHd 

q; 

a: 

« 

« 

h) 

dc5  ajd 

* 

* 

* 

d 

aa 

^bixi;u> 

1  ot)H 

o 

« 

« 

Eh 

r^dbab) 

* 

* 

* 

d 

Endbi 

1  «l<3l>3 

H 

« 

•It 

a« 

CO 

CO  ocoa; 

* 

* 

* 

ba 

d 

d’ssd 

o 

b) 

* 

« 

aj 

Hco  Cibj 

* 

* 

* 

? 

d 

EnXdd 

V  X 

b) 

« 

* 

asHd  d 

« 

* 

■it 

Eh 

dcjd 

t  QiiJO 

5k 

« 

« 

•  • 

Hasbabid 

« 

* 

* 

d 

d  Eh 

K 

% 

Q 

« 

* 

a; 

EnCoasH 

•it 

* 

■it 

d 

d 

ddcjd 

k  ooHfri 

b] 

b] 

« 

* 

•• 

ba 

^EhQ  • 

* 

•it 

■It 

Eh 

Enddd 

if  +b3«< 

N 

« 

* 

s; 

..:^d  d 

* 

•It 

■It 

Eh 

^biH 

8:  »H+Q5 

H 

H 

« 

* 

o 

% 

dH  codcj 

* 

•It 

■K 

% 

d  dd  o 

a  '-'0  + 

bi 

ca 

« 

* 

H 

■< 

d  C0b)«<«H 

* 

•It 

■it 

bq 

d 

d  dd  ■f 

+ftjO 

a; 

« 

* 

Eh 

a; 

ddbadasEn 

* 

•It 

■it 

Eh 

Eh  •  d  Cj 

pr  ^:k6j 

Eh 

« 

* 

Cj 

CJ 

ddddbaCj 

* 

•it 

■It 

baod 

ddxdad 

V  xEs::^ 

a: 

Q 

« 

* 

a: 

CJ 

dod^bk^ 

* 

* 

■K 

co^fba 

ddHd-Ea^ 

’>  ina:Q 

Ci 

% 

« 

Cl 

a; 

dO"«dbad 

* 

* 

* 

<t<bq 

End  dd 

V 

H- 

« 

•It 

h< 

ai 

dddbqdd 

-  * 

«- 

badd 

:kCjEHd*««S! 

•>  OH><< 

bl 

Eh 

« 

•K 

•it 

* 

■it 

dEHdad«t«5edEHEH 

V  ♦fiQEs 

CO 

«o 

•It 

« 

* 

* 

dNd  +  dbidxdd 

y  ccrkco- 

«  to 

* 

*- 

w  »  1 

-  Eh 

1-  d 

; - EhEh 

a  a 

aaaaaaaaaaaaaa 

r  ■■■■  ju)u)r^OPO>OriC>JCn ju)ior^000)0 

rH  <N  cn  ^  in  lO  r>  00 0>  r-»  rH ’rt  ^  T-l  ri  <S  CM  C>l  CN  <M  CM  CM  CJ  <N  CO 


TOT A L VEC* l^TOTAL VEC 
LliK-irK^l 


« 

^  P  •q::^ 

Me 

» 

Mt 

HPQbabJ 

Me 

« 

■tftpajpp 

Me 

o 

•it 

r^-ecajEMpha 

Me 

« 

Me 

CN 

« 

bal^  b^iqjiq; 

Me 

* 

« 

aappppH 

Me 

II  *11 

II 

* 

CN. 

EmI-iEm  P 

Me 

II-  II 

—  • 

II 

« 

oo 

Em  >m>mP 

Me 

II 0:  II 

O  1 

II 

« 

at 

b^paaEspco 

Me 

11  O  II 

•  1 

II 

Ox 

ri 

P^^baHpCO 

Me 

II  Em  II 

1 

II 

* 

a: 

pC3a;ba>q; 

« 

II  Cj  II 

II 

* 

bah4a;cj&M 

« 

II K];  II 

bj  1 

^11 

Mt 

P  PbMCOCO 

Me 

II  (*4  II 

5  ' 

'^ii 

Mt 

Hb;  aaHEM 

Me 

II  II 

53  1 

Cjii 

« 

»0 

EMb^ascciCoa; 

Me 

II  II 

Oi 

ba  11 

« 

o 

pa;H  pcq 

Me 

II  o  II 

ha  1 

fib  II 

« 

CJ 

CM 

pem  baps  • 

Me 

II  II 

bjii 

Mt 

o:qcCi,a:pb3S 

Me 

II  Co  II 

C3  1 

•q;  II 

« 

Ox 

oaSajEi  EmP 

Me 

II  ba  II 

b] 

bj  1 

Em  II 

Mt 

CO 

•  • 

p  <q;  ba*tb.M 

Me 

II  (j  II 

bO 

53  1 

CJII 

Mt 

bj 

ba 

PP  PPEmEm 

« 

II  H  II 

Em 

O  1 

Em  II 

< 

a; 

Em 

pbaEMEMCOP 

II  Qa  II 

H 

as  1 

'^11 

Me 

CJ 

•56 

"^EhP  ^ 

II  Em  II 

Em 

CO  1 

+  II 

Me 

53 

EmP  -EmP 

< 

II  •qc  II 

C3 

N-^ll 

Me 

PS  a:>Ma;b4 

Me 

II  s;  II 

CO  1 

011 

Me 

■IPSb-MbJI-l 

Me 

II  II 

03 

Em  I 

II 

Me 

caaHPbjajp 

Me 

lllq  II 

I 

a  II 

Me 

pbM  S<q:(x,iNi 

Me 

II  II 

*  ^ 

ha  1 

II 

Mt 

ba  pp;%  a: 

Mc 

II  ■*;  II 

-  b3 

%  I 

to  II 

Me 

SXbaaiCjbaEs 

Me 

II  II 

ha  1 

"-'ll 

Me 

PbHSbPb.,Ja; 

Me 

II  II 

••  Em 

bj  1 

•II 

Me 

bsbapCtaEMEMi^ 

Me 

II H II 

ba  1 

-  II 

Me 

P 

PEMpa;bM  b.) 

Me 

II  II 

^  Em 

II 

Me 

CO 

Etaiq;fibl3;C3 

Me 

II  CO  II 

fib  W 

CO  1 

II  II 

Me 

PS^PP  'P 

Me 

II  Em  II 

b3  • 

CJ 

a;  1 

II 

Me 

bj 

bMp»<baba 

Me 

II  %  11 

bq  - 

b3 

P ' 

Me 

53 

PEo 

Me 

II  EO  II 

fib 

Em  I 

53  II 

Me 

a: 

NPPP  i-mH 

Me 

It  %  II 

ba  •• 

.1.3 

Cj  I 

COM 

Mt 

•t 

6*i«eS6s  kEsiqS 

Me 

II  Cx]  II 

?! 

ba  1 

II 

Me 

S  PPPPEm 

Me 

ba 

II  1.3  II 

Cj  p 

Em 

bk  1 

II 

Me 

a; 

• 

PpbnPPCJS 

Me 

II  b]  II 

H  Em 

O 

II 

Me 

p 

% 

bHp&Mb«IPPP 

Me 

9 

II  II 

a;  Ej 

Em 

b4  1 

II 

Me 

Em 

EMbc*M;p<q:pp 

Me 

o 

II 0;  II 

5^  ^ 

0 

O  1 

II 

Me 

Cj 

piqrprkpp 

MC 

?! 

II  o  II 

o;  h. 

II 

Me 

ba 

Eq 

SEmP  spp 

MC 

6m 

II  bt  II 

«< 

to 

%  1 

II 

Me 

fib 

fib 

P  pb^o  P 

Me 

«0 

i-a 

II  II 

=3  1 

II 

Me 

a; 

b.6HpPPPP 

Me 

* 

II 0;  II 

b3 

in 

CO  1 

II 

Me 

ba 

Em 

b.|"< 

Me 

Em 

II  o  II 

H 

1  1 

II 

< 

CJ 

CO 

P  PPPP 

< 

O 

II  Em  II 

a: 

m 

1  1 

II 

bM 

bi  PPEmP 

•K 

Em 

II  Cj  II 

• 

bj  1 

II 

ba 

P  kpEMbM  p 

• 

II  Eo  II 

CJ  1 

II 

« 

•0 

EmS^PPP*? 

II  II 

•• 

E«a  1 

II 

Me 

a; 

^Esppb.! 

« 

Em 

Cq 

II II 

a; 

a:  1 

II 

Me 

•• 

ba 

P 

Me 

P 

II  b]  II 

o 

Cj  1 

II 

Me 

% 

••PPSPPEm 

MC 

Em 

II  Cd  II 

Em 

II 

Me 

o 

% 

ppspempk; 

Me 

♦  tMH 

II  H  II 

Cj 

II 

Me 

H 

ppppp«tp 

Me 

Pi-30J 

II  b3 11 

b3 

II 

Me 

Em 

a; 

PPPPPS 

Me 

Babj'^  + 

fib 

« 

Cj 

p 

P  PPS  P 

« 

coSk-^O 

« 

% 

p 

PPP  ppb4 

« 

KtlJift&J 

ba 

« 

53 

a: 

ppppbjccp 

« 

0Q«t:  - 

• 

•  — 

CJ 

Me 

h. 

Om 

Ps:P'q:p*q:EM 

« 

OiEMinSCi 

H- 

Me 

« 

a;Ov-M-< 

03 

o 

Me 

Me 

«tcEM  +  nj-  - 

•  — 

-  -  fo 

Me 

Me 

aaaaaaaaaaaaaaa 


r-ynt"  r ■  ■  ■-w—g-i  »'  »  ■»"i— «  ■'  »  t  ■  »"r'r  «  »  i 

»-•  <N  m  a"  «n  <D  00  o>  o  rH  CM  <n  S’ If)  vo  00  C35  o  rK  <N  to  d- in 
to  to  <o  to  to  to  to  CO  CO  a- S’ 3- S' a' ^  a"  S’ a"  a- in  in  in  m  m  in 

I  »  *  «  »  »  «  «  «  «  » 


r'M  ■■III 

r— »—»—¥— r-  ill!  lOrHCMroain 

tM  CN  CO  a  in  to  00 13>  rH  tM  tM  tH 


•* 


'4 


•'is 

) 


MJ 

•'i. 


n 

vs 


03  * 
* 

>i  * 

O  * 

?  * 
&3  * 

* 

VI  * 
H  * 
Vi  * 


U)  00  o*  o  th  CM  CO  a- in  u)  po  00  01  o  th 
tM  Ti  tl  tM  CM  CM  CM  CM  CM  CM  CM  CM  CM  CM  CO  cn 


•K 

R 

•K 

R 

R 

« 

R 

R 

« 

R 

R- 

« 

R 

bJH 

REm 

* 

R 

a; 

R5>- 

* 

R 

EMCb 

RQ4  • 

« 

« 

X 

RS&a 

■K 

R 

xs 

RNO 

« 

R 

EmH 

■*'  3 

•It 

R 

•qjKj; 

RC)a4 

* 

R 

EmEm 

rEmCO 

at 

« 

R 

COS 

R  X 

a 

■R 

R 

SCS 

rsx 

• 

•K 

R 

p- 

c:>o 

RCiO 

rH 

« 

R 

GO 

s 

RXS 

Q. 

•R 

« 

05 

xco 

« 

1  (o  a 

0 

R 

« 

04 

CiS 

RStO 

-  1  '«^in\coTM 

cn 

« 

R 

% 

0 

ROH 

X  •  tM  tM 

« 

•K 

*3! 

s 

QH 

RXX 

1 

• 

« 

R 

*< 

SEm 

R  Em 

1 

« 

R 

■acO 

■itS^ 

1 

a* 

•R 

R 

•• 

S 

ROS 

1 

a 

■R 

R 

b] 

a* 

sa 

RXH 

•  CO  cn 

• 

•R 

R 

0 

HX 

RCO 

0  1  CMHP'.tMV* 

tH 

m 

■R 

R 

■< 

R  Ci 

1  tM  iM 

q: 

« 

« 

O4 

RCSX 

1 

m 

Q. 

CO 

•• 

REmS 

1 

a 

UJ 

X 

Eq 

XEm 

R  H 

1 

• 

0 

R 

R 

X 

Em 

X 

RCjio; 

1  PN. 

rH 

«»• 

R 

•JC 

0 

•o: 

0 

rXEm 

C 

3 
1 
1 
/ 

4 

C) 

R 

s 

Q 

CSEm 

RSS 

1  tM 

CirM 

s 

« 

EmS 

RtiCi 

1 

»a 

» 

R 

H 

RHO- 

1 

X 

03 

R 

Q 

RCO  •• 

1 

»  (Oirt 

CO 

0 

R 

b]iq: 

RXCOX 

1  a  in 

0 

R 

SEm 

RSSH 

X  •  ^tMtMCOV. 

CO  incM 

m 

03 

R 

o«< 

R  OX 

1  ri  tH 

wen 

Nm/ 

At 

« 

S 

HS 

RSHEm 

1 

^  «»  • 

* 

R 

0 

CO 

roemio: 

1 

w  .  ri 

R 

CO 

Eqx 

RHOS 

1 

•tM 

0 

R 

03 

QH 

REmS 

1  COCN 

“I  ‘^a 

•• 

R 

X 

S 

R  OOm 

1  tManv^CO 

^  XCM 

0 

Q 

R 

Q 

COEm 

rSI*4X 

1  TMtM 

b]  • 

s 

% 

R 

S 

*^3 

RO  in 

1 

'^d  QtM 

Em 

Eq 

R 

S-«-  a; 

«?! 

R 

s 

R  XX 

*  Em 

*  C» 


.  Oti 
S  HS: 
EmH 

Eq  &;la] 

^  C3Em 

^  b4;^ 

Em  t*3  . 
CO  Vi  &3 
PmC^CJ 

a:o^ 


+  XX 

*CM. 

c5  • 

0 

R 

« 

•* 

Em  X 

(V^  X— -x 

Oo 

0 

« 

« 

X 

XX 

mX  •'vM» 

X 

R 

R 

•• 

X 

■tx 

II H 

X 

0 

R 

R 

s 

s 

••sx 

.+  XvX 

• 

R 

R 

0 

s 

X  0 

»  +  <j>inx 

•f 

0 

R 

R 

H 

«< 

xxs 

■< 

W 

R 

R 

Em 

X 

ox 

x^  ^  + 

w 

R 

R 

0 

C5 

XXX 

•4- 

a 

« 

R 

S 

0 

XC3H 

M-rMw 

0 

« 

« 

X 

X 

oxx 

m»Xm* 

w» 

0 

« 

« 

X 

X 

XXEm 

«?X  ♦X  X  rM 

« 

« 

* 

+ 

R 

R 

xx^x+x- 

-  X- 

-  0- 

- 

RO 

R 

•)e»a:a5i«3 

«  EmQ4 

*  -0:5 

■< 

*0&3>« 

«a:a:ii3 

*EmEm 

•«i&tM 

«K,5;C0 

*  HH 

*0 

*  Em  <9: 14 

*  EmO 
«b]R;C>^ 
CSOEQ 
«0  B» 

•It  OX 

■icbjcc;^ 

■it:4EMO- 

*  «t5J: 

*  SCO 

_ 


■aeCQOCil^ 


>■■■■■  ■ "  w  iOr^CNc^:J'U^cor>»coO)OTH<Ncn:^ 

r^C*4CO:HntDP^OOQ>r4r^^T^THT^^tHfHrHCNC^C^CSCS 


>-rvu\Af-/vx\AZ»r 


THE  ACTUAL  DATA  THAT  IS  ENTERED  IS  ONLY  THE  UPPER  TRIANGULAR  PART  OF 


m  to  «>•  00  O)  o  t-i  <N  (Tj  S’ m  lo  00  O’ o 

CMCMCNCNCNPicocncT’cnmncnPOCTj:!’ 


t-r--r-»  ■  »  ■  ■  »  lOT^CNCOJ-LOUjr^OOOlOT-ICNmJ- 
T-t  CN  CO  O’ »0  VD  00  O’ ft  Ti  rH  Tl  T-(  ri  T-l  rH  CM  CM  CM  CM  CM 


mmmm 


J 


«  C)  «  « 

*  QBq  *  * 

*  XbQiS;  «  « 

«  HCO^  «  « 

«  q:C3Co  «  « 

«  i^Bh  Co  «  * 

*  0'^Es«5S  *  * 

«  HSC5  *  * 

*  Es  :5co  *  * 

*  cj:^  N  *  * 

*  aoco  *  * 

« 

acoH^ 

« 

« 

« 

b^H 

« 

« 

« 

00 

03040- 

« 

« 

« 

cn 

bj«qaCJ 

« 

« 

« 

A, 

S04«qa 

« 

* 

aj 

0; 

« 

* 

a: 

cooacb 

*  •• 

« 

« 

OH 

*a 

« 

« 

b]  £U 

♦  a 

« 

« 

•• 

a:i^ab: 

« 

« 

Co 

CM 

Esabi«q; 

<a 

•K 

« 

Cj 

CM 

oa; 

*a 

« 

« 

s:  Hbj 

«a 

« 

« 

0;t>-i*t£q 

« 

« 

« 

CO 

•  • 

OaEsEs 

*>t 

« 

X 

Co 

b.a:a: 

« 

* 

Cq 

Es 

Q30Cja 

«a 

« 

* 

O 

*q 

b3  Cj6h 

«Es 

« 

:% 

Q 

04^  H 

« 

« 

EhS::^ 

« 

CJHO 

« 

% 

« 

EnaHX 

«a 

■t 

« 

EhEh 

♦  a 

a 

a 

« 

acocjH 

*6h 

a 

a 

« 

b30;ao; 

« 

ti. 

a 

« 

aEoa>q 

•«a 

Eh 

a 

« 

a: 

arcoOH 

«a 

a 

a 

« 

Q 

bjaoskj 

« 

a 

« 

CO 

Eh  EhN 

*Eh 

::^ 

N 

a 

« 

03 

a;o:a:s; 

*a 

a 

a 

* 

b] 

X 

a 

« 

C) 

b4  b4 

«a 

H 

» 

a 

* 

a: 

CO  X 

« 

« 

naiao; 

«a 

Eh 

m 

a 

« 

oabj 

3 

« 

• 

SHEhCO 

«a 

s; 

m 

« 

« 

% 

•tEnOa 

♦  a 

« 

« 

Ojas  *a  03 

m 

« 

« 

a: 

aabjco 

«a 

« 

* 

b] 

aafcjm 

a 

« 

* 

b] 

N 

03  b, 

inO 

•« 

« 

« 

Cq 

04  bj  « 

«a 

a 

« 

* 

Ci 

&H 

04as: 

«6h 

OCJ 

CJ 

* 

* 

CO 

CoaEn^ 

* 

«a 

Eh 

* 

« 

H«q  a 

«a 

a 

« 

« 

CO 

a  a 

■*a 

a 

« 

« 

•• 

Ena  *0 

•«a 

aa 

3s. 

* 

« 

03 

naa 

*a^ 

XCJ 

a 

* 

« 

•• 

bj 

*a 

OOH 

a 

* 

« 

s 

••5:x 

« 

+a 

a 

« 

* 

O 

% 

a  aa 

«a 

-H  + 

H 

* 

* 

H 

■q 

aa«qa 

«a 

wO 

a 

« 

* 

Eh 

03 

oaaa 

«Eh 

+a 

* 

« 

Cj 

Ci 

a&H-sjEH 

* 

Eh 

* 

* 

CJ 

a 

*a; 

xEh 

a 

* 

« 

a 

? 

aaoa 

•«a 

tna 

a 

* 

« 

a«<EHN 

«Eh 

•0“ 

H 

« 

« 

«ac3oa 

a 

« 

« 

«a 'E  'Ea 

a 

« 

« 

*-  :i.aa- 

«[ 

1 

■ 

APPENDIX  E 

GOAL  PROGRAMMING  SOFTWARE  SUPPORT 


This  appendix  Includes  a  discussion  of  the  software 
that  was  used  and  developed  In  order  to  determine  the 
optimal  funding  level  for  each  of  the  major  project  In 
the  SDI  program  being  studied. 

The  final  steps  in  the  GP  model  solution  process 
entailed  finding  and  using  a  suitable  optimizing 
program.  Several  excellent  linear  and  non-linear 
programming  packages  are  available,  such  as  the  Linear 
Interactive  Discrete  Optimizer  (LINDO)  [Ref,  39]  or  the 
General  Interactive  Optimizer  (GINO)  [Ref.  40].  Both 
programs  are  simple  and  can  be  used  on  an  IBM  PC,  but 
they  lack  the  tremendous  power  and  flexibility  of  the 
recently  developed  General  Algebraic  Modelling  System 
(GAMS)  [Ref.  41]. 

GAMS  was  written  by  Brooke,  Drud,  and  Meeraus  of 
the  Development  Research  Department,  World  Bank.  It  is 
the  first  optimizing  program  that  uses  the  special 
mathematical  nota^  m  called  the  Backus-Nauer  Form 
( BNF ) .  This  notat'on  enables  the  user  to  write 
constraint  equations  In  a  more  generalized  and  compact 
style  than  other  packages.  GAMS  also  has  the 
capability  to  handle  nonlinear  and  integer  programming 
problems.  Additionally,  since  program  coding  Is  very 
terse,  changes  are  extremely  easy  to  make,  an  advantage 
that  will  be  exploited  In  the  next  chapter.  Dr. 
Richard  Rosenthal  of  the  Naval  Postgraduate  School  has 
referred  to  GAMS  as  "perhaps  the  most  significant 
development  In  the  field  of  operations  research  In  the 
last  five  years"  [Ref.  42], 

A  GAMS  program  was  written  (see  Appendix  E)  based 
on  the  GP  model  of  the  major  projects  of  the  USASDC . 
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For  the  reader  vmfamlllar  with  GAMS  procedures,  a  short 
discussion  of  this  program  is  appropriate.  The  SET 
command  establishes  a  set  1,  consisting  of  the  WPD 
numbers  of  the  thirty-five  projects  being  modelled. 
There  are  six  PARAMETER  statements;  the  numerical  value 
of  the  minimum  and  maximum  funding  level,  as  well  as 
the  payoff,  risk,  time,  and  balance  weight  value  of 
each  project  are  entered  as  parameters.  SCALARS 
include  the  total  budget  available,  based  on  the 
funding  strategy,  and  the  weight  coefficients  for  the 
four  deviation  variables.  The  decision  variable,  XI, 
representing  the  money  to  be  spent  on  the  1th  project 
In  FY  88,  is  listed  under  the  VARIABLES  command.  Also 
displayed  here  are  all  eight  deviation  variables  and 
the  achievement  function  variables.  The  POSITIVE 
VARIABLES  command  ensures  non-negativity  of  all  listed 
variables.  The  coding  under  the  EQUATIONS  command  is 
in  BNF  format  but  includes  all  the  system  and  goal 
constraints  of  the  GP  model.  COST  refers  to  the  budget 
constraint  that  cannot  be  exceeded.  PAYOFF,  RISK, 
TIME,  and  BALANCE  each  represent  a  goal  constraint. 
OBJDEF  is  the  achievement  function.  The  mlnlm\im  and 
maximum  funding  constraints  are  singleton  equations  and 
are  listed  as  upper  and  lower  bounds  below  the 
EQUATIONS  section  of  the  program.  The  final  part  of 
the  coding  refers  to  formatting  and  output. 

This  concluded  the  data  collection  and  software 
development  process.  With  AHP  and  GP  model  properly 
supported,  all  that  remained  was  to  actually  run  the 
model  and  analyze  the  results. 


BAMS 


PROGRAM 


FORMULATION 


m 

M 

UKU 

II 


'■« 


♦TITLE 

♦OFFUPPER 

♦OFFSYMLIST  OFFSYWOIEF 


BP  TMESIS  -  ANDERSON 


SET  I  ihir'ty-f iv«  Mjor  USASDC  project*  in  fiv«  prograa  claMr 

/B1Z2,B142.B412,B5S2,BA12>L008,L212>L50S>L721>L72S, 
0044,0076 ,00e0 ,0047,0112 ,0114,0083 ,K222 ,K623 ,K624 , 

K225 ,K323 ,K325 ,K524,K321 ,S271 ,S051 ,S011 ,S052 ,S053 , 

S243 ,S402 ,S091 ,S102 ,S281/ » 

PARAMETER  MIN(  1 )  ain  fmling  laval  for  aach  pro jaot  -  Mdollara 


PARAMETER  MAXI  I )  aai 


/B122 

6 

B142 

2 

B412 

4 

BS32 

30 

B612 

2 

LOOS 

S 

L212 

2 

L503 

5 

L721 

2 

L723 

2 

0044 

1 

0076 

50 

0080 

5 

0047 

15 

0112 

1 

0114 

6 

0083 

12 

K222 

40 

K623 

5 

K624 

10 

K225 

6 

K3Z3 

3 

K325 

4 

K524 

4 

K321 

35 

S271 

25 

S051 

15 

soil 

3 

S052 

15 

S053 

3 

S243 

3 

S402 

3 

S041 

5 

S102 

2 

S281 

12/ 

<  r#Qcl 

/B122 

37 

B142 

15 

B412 

28 

B532 

95 

B612 

25 

L008 

30 

L212 

12 

L503 

24 

L721 

12 

L723 

10 

0044 

15 

aach  progran  -  Mdollara 


I.. 


i 


4 


i 

I 

I 

f 

h 

J 


m 


0076 

260 

0080 

25 

0047 

S5 

0112 

8 

0114 

20 

0083 

80 

K222 

187 

K62S 

28 

K624 

45 

K22S 

20 

KS23 

50 

K325 

25 

K524 

25 

K321 

204 

S271 

105 

S051 

20.5 

soil 

13.3 

S0S2 

31 

S0S3 

19.2 

S243 

15 

S402 

35 

S091 

35.5 

S102 

20 

S281 

159. 4i 

PARAMETER  COREdl  funds  for  sach  program  i  for  eora  sfratagy  -  Mdollars 


/B122 

20 

8142 

6.2 

8412 

8.1 

8532 

30 

8612 

7 

LOOS 

14.6 

L212 

3.7 

L503 

8.5 

L721 

4.8 

L723 

4 

0044 

5 

0076 

158 

0080 

5 

0047 

34.4 

0112 

3 

0114 

12 

0083 

55 

K222 

150 

K623 

24 

K624 

38 

K2Z5 

6 

K323 

3 

K325 

5 

K524 

12 

K321 

58 

S271 

82.3 

S051 

16.4 

soil 

10.7 

S052 

22.2 

S053 

7.3 

S243 

9.8 

S402 

15.4 

S091 

13.1 

S102 

10 

S281 

20.1/» 

Xl5 


PARAMETER  BASZC(X)  firtd*  for  —eh  progr—  i  for  booio  sirofogy  -  Mdolloro 


/B122 

20 

B142 

6.2 

B412 

10 

B532 

38.5 

B612 

7 

L008 

16 

L212 

3.9 

L503 

9 

L721 

5.1 

L72S 

4.3 

0044 

5 

0076 

170.6 

0080 

5 

0047 

34.4 

0112 

7 

0114 

12 

0083 

61 

K222 

150 

K623 

24 

K624 

38 

K225 

a 

K323 

5 

K22S  5 

K524  12 

K321  129 

S271  95 

SCSI  16.4 

son  10.7 

S052  22.2 

S0S2  7.3 

S243  9. a 

S402  15.4 

S091  15.3 

S102  11.7 

S281  39.3/» 

PARAMETER  ENHANCED(I)  funds  for  ooch  progrM  i  for  orhancod  sfroiogy 


/B122 

24.5 

8142 

7.7 

8412 

10 

8532 

51.1 

8612 

12.9 

LOOS 

18 

L212 

4.2 

L503 

10 

L721 

5.6 

L723 

4.8 

0044 

8 

0076 

186.5 

0080 

5 

0047 

37.4 

0112 

7 

0114 

12 

0083 

61 

K222 

177 

K623 

24 

K624 

38 

K225 

16.6 

K323 

25 

K325 

5 

K524 

14 

K321 

194 

S271 

95 

S051 

16.4 

M 


L723 

D044 

0076 

0080 

0047 

0112 

0114 

0083 

K222 

K623 

K624 

K225 

K323 

K325 

K524 

K321 

S271 

5051 
SOU 

5052 

5053 
S243 
S402 
S091 
S102 
S281 


.023 

.007 

.015 

.035 

.008 

.065 

.065 

.004 

.021 

.021 

.049 

.031 

.031 

.031 

.025 

.018 

.019 

.027 

.081 

.027 

.011 

.008 

.033 

.016 

.032 

.031/) 


PARAHETER  B(l)  balance  Mai^t  factor  for  aaeh  prograa  datarainad  by  AMP 


/B122 

8142 

8412 

8532 

8612 

L008 

1.212 

L503 

(.721 

L723 

0044 

0076 

0080 

0047 

0112 

0114 

0083 

K222 

K623 

K624 

K225 

K323 

K325 

K524 


.025 

.025 

.027 

.033 

.033 

.029 

.029 

.029 

.029 

.029 

.030 

.027 

.027 

.027 

.030 

.030 

.027 

.036 

.036 

.021 

.021 

.021 

.021 

.036 


K321 

S271 

5051 
SOU 

5052 

5053 
S24S 
S402 
S091 
S102 


.036 

.033 

.030 

.030 

.030 

.028 

.024 

.024 

.034 

.028 


■^5 

m 
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SCALARS  BUDGET 
HTPNEO 
HTRPOS 
WTTPOS 
KTBNEG 


io*ml  budgai  (CORE)  in  FY  88  HdolUra  /88Z.6/ 
Mai^t  of  payoff  nag  daviation  in  OBJOEF  /.ZSO/ 
Naighf  of  risk  po«  daviafion  in  OBJOEF  /.ZSO/ 

waighf  of  fima  pos  daviafion  in  OBJOEF  /.ZSO/ 

Haight  of  balanca  nag  deviation  in  OBJOEF  /.250/> 


VARIABLES 

X( I )  aonay  to  ba  apand  in  aach  program  during  FY88 

PROS  positive  deviation  from  the  payoff  goal  constraint 

PNE6  negative  deviation  from  the  payoff  goal  constraint 

RPOS  positive  deviation  from  the  risk  goal  constraint 

RNE6  negative  deviation  from  the  risk  goal  constraint 

TPOS  positive  deviation  from  the  time  goal  constraint 

Tf£6  negative  deviation  from  the  time  goal  constraint 

BPOS  positive  deviation  from  the  balanca  goal  constraint 

BNEG  negative  deviation  from  the  balanca  goal  constraint 

DEVIATION  deviation  from  the  objective  function) 

POSITIVE  VARIABLES  X>  PPOS>  PNEG>  RPOS,  RNE6,  TPOS,  TNEG,  BPOS,  BNEG) 

EQUATIONS  COST  oost  of  prograsis  cannot  exceed  the  budget 

PAYOFF  goal  nui^ar  1  -  maximize  payoff 

RISK  goal  ntinber  2  -  minimize  risk 

TIME  goal  number  S  -  minimize  time 

BALANCE  goal  number  4  -  maximize  balance 

OBJOEF  achievesient  fijriction) 


COST. . 

SUM 

(I, 

XID) 

>L3  BUDGET) 

PAYOFF.. 

SUM 

(Z, 

X(Z)  « 

P(I)) 

-  PPOS  *  PNEG 

■E*  SUM  II, 

P(I) 

«  MAXID)) 

RISK.. 

SUM 

II, 

X(I)  » 

RID) 

-  RPOS  *  RNEG 

3E3  SUM  II, 

RID 

»  MINI!))) 

TIME.. 

SUM 

(I, 

X(I)  « 

TID) 

-  TPOS  ♦  TNEG 

«E3  SUM  (I, 

TID 

a  MINI!))) 

BALANCE . . 

SUM 

il. 

X(Z)  • 

BID) 

-  BPOS  *  BNEG 

3E3  sum  (I, 

BID 

•  MAXID)) 

OBJOEF.. 

(HTPNEG 

•  PNEG)  ♦  (NTRPOS  •  RPOS)  ' 

) 

(HTTPOS 

«  TPOS)  *  (HTBNEG  *  BNEG) 

«E« 

DEVIATION) 

•  additional  constraints  involving  max  and  min  fvrtding  levels 
X.LOdI  -  MIN(I)) 

X.UP(I)  3  MAXID) 

NOOEL  GP  /ALL/) 

SOLVE  GP  USING  LP  MINIMIZING  DEVIATION) 


PARAMETER  REPORTl  (I>«)  oOMparision  of  op'tiM  Mi'th  fvnding  lavali 


REPORTl 

II, 

■MINIMUM*  ) 

a  MINI!)) 

REPORTl 

II. 

■OPTIMUM* ) 

a  X.LID) 

REPORTl 

II, 

■CORE*  )  » 

COREID) 

REPORTl 

II. 

■OIFF*)  a 

X.LID  -  COREID) 

REPORTl 

II, 

•'/  OIFF*  ) 

a  IX. LID  -  COREID)/! X.LID)) 

REPORTl 

II. 

■MAXIMUM*  ) 

a  MAXID) 

PARAMETER  REPORTS 

!•)  listing  of  goal  constraint  RHS  targats) 

REP0RT2  ('TARGET  1')  =  SUM  (1,  P(I)  *  MAX(I)>» 

REPORTS  ('TARGET  2' )  «  SUM  (I,  R(I)  •  MIN(I))» 

REPORTS  ('TARGET  3*)  «  SUM  II,  Til)  •  MINII))| 

REPORTS  I 'TARGET  4')  »  SUM  II,  BID  *  HAXII))t 

PARAMETER  REPORTS  (•)  laasi  squares  and  average  deviation  figures > 
REPORTS  I'LST  SGRS' )  -  SUM  ( I ,SQRI X. L( I )  -  COREII)))) 

REPORTS  I'AVE  OEV  )  «  ISUM  1 1 ,1 1  X.LI  I  )-COREI  I)  )/IX.  LI  I ) ) ) )  )/35» 
PARAMETER  REP0RT4  !•)  total  budget  check) 

REP0RT4  I 'TOTAL  BGT*  )  »  SUM  (I,X.LII)) 

OISPLAV  REP0RT4) 

DISPLAY  REPORTl) 

DISPLAY  REPORTS) 


DISPLAY  REPORTS) 


APPENDIX  F 
AHP  OUTPUT 


The  APL  workspace  discussed  In  Chapter  VI  and  shown 
in  Appendix  F  was  used  to  determine  the  coefficients 
for  the  goal  constraint  equations  in  the  main  GP 
program.  The  AHP  program  In  the  workspace  was  run  four 
different  times  to  calculate  payoff,  risk,  time,  and 
balance  weights  for  each  project.  In  the  interest  of 
brevity,  only  the  comparison  matrices,  consistency 
ratio  Information,  and  eigenvectors  from  the  payoff 
factor  output  are  displayed  on  the  following  pages. 


AHP  DATA  FOR  MATRIX  NUreER  1 


FACTOR:  POTENHAL  CONTRIBUTION  TO  SOI 
GROUP:  SABM  PROJECTS 


COMPARISON  MATRIX 


1.000 

1.000 

2.000 

1.000 

5.000 

1.000 

1.000 

2.000 

1.000 

5.000 

.500 

.500 

1.000 

1.000 

5.000 

1.000 

1.000 

1.000 

1.000 

5.000 

.200 

.200 

.200 

.200 

1.000 

LAMBDA!  MAXIMUM):  5.078 
CONSISTENCY  INDEX:  .019 
CONSISTENCY  RATIO:  .017 

HEIGHT  EIGENVECTOR:  .269  .269  .181  .234  .047 
STANDARDIZED  HEIGHTS:  .038  .038  .026  .033  .007 


AHP  DATA  FOR  MATRIX  NUMBER  2 


FACTOR;  POTENTIAL  CONTRIBUTION  TO  SDI 
GROUP:  SLKT  PROJECTS 


COMPARISON  MATRIX 


1.000 

1.000 

1.000 

3.000 

3.000 

1.000 

1.000 

1.000 

3.000 

3.000 

1.000 

1.000 

1.000 

3.000 

3.000 

.333 

.333 

.333 

1.000 

1.000 

.333 

.333 

.333 

1.000 

1.000 

L  Amo  A  (MAXIMUM):  5.000 
CONSISTENCY  INDEX:  .000 
CONSISTENCY  RATIO:  .000 


HEIGHT  EIGENVECTOR:  .273  .273  .273  .091  .091 
STANDARDIZED  HEIGHTS:  .039  .039  .039  .013  .013 


AHP  DATA  FOR  MATRIX  NUmER  3 


FACTOR:  POTENTIAL  CONTRIBUTION  TO  SOI 
GROUP;  DEH  PROJECTS 


COMPARISON  MATRIX 


1.000 

1.000 

7.000 

3.000 

8.000 

9.000 

3.000 

1.000 

1.000 

7.000 

3.000 

8.000 

9.000 

3.000 

.143 

.143 

1.000 

.250 

5.000 

6.000 

.250 

.333 

.333 

4.000 

1.000 

5.000 

6.000 

1.000 

.125 

.125 

.200 

.200 

1.000 

4.000 

.143 

.111 

.111 

.167 

.167 

.250 

1.000 

.111 

.333 

.333 

4.000 

1.000 

7.000 

9.000 

1.000 

LAmOAC  MAXIMUM ) ;  7.648 
CONSISTENCY  INDEX:  .108 
CONSISTENCY  RATIO:  .082 
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HEIGHT  EIGENVECTOR:  .SOS  .SOS  .064  .IS2  .0S2  .019  .148 
STANOAROIZED  HEIGHTS:  .061  .061  .OIS  .026  .006  .004  .OSO 


AHP  OATA  FOR  HATRIX  NUTCER  4 


FACTOR:  POTENTIAL  CONTRIBUTION  TO  SOI 
GROUP:  KEH  PROJECTS 

COMPARISON  MATRIX 


1.000 

9.000 

9.000 

3.000 

3.000 

3.000 

5.000 

1.000 

.111 

1.000 

.333 

.143 

.143 

.143 

.200 

.111 

.111 

3.000 

1.000 

1.000 

1.000 

1.000 

5.000 

.333 

.333 

7.000 

1.000 

1.000 

1.000 

1.000 

5.000 

.333 

.333 

7.000 

1.000 

1.000 

1.000 

1.000 

5.000 

3.00 

.333 

7.000 

1.000 

1.000 

1.000 

1.000 

5.000 

.333 

.200 

5.000 

.200 

.200 

.200 

.200 

1.000 

.200 

1.000 

9.000 

3.000 

3.000 

3.000 

3.000 

5.000 

1.000 

lambda:  MAXIMUM);  8.628 
CONSISTENCY  INDEX:  .090 
CONSISTENCY  RATIO:  .064 

HEIGHT  EIGENVECTOR:  .SOS  .019  .087  .104  .104  .104  .0S7  .24S 
STANDARDIZED  HEIGHTS:  .069  .004  .020  .024  .024  .024  .008  .055 


AHP  OATA  FOR  MATRIX  NUMBER  5 


FACTOR;  POTENTIAL  CONTRIBUTION  TO  SOI 
GROUP:  SATKA  PROJECTS 

COMPARISON  MATRIX 


1.000 

3.000 

3.000 

3.000 

3.000 

2.000 

3.000 

3.000 

4.000 

3.00 

.333 

1.000 

1.000 

1.000 

1.000 

.333 

2.000 

1.000 

2.000 

3.00 

.333 

1.000 

1.000 

1.000 

3.000 

.333 

2.000 

3.000 

3.000 

3.00 

.333 

1.000 

1.000 

1.000 

2.000 

.333 

2.000 

.500 

2.000 

2.00 

.333 

1.000 

.333 

.500 

1.000 

.333 

1.000 

1.000 

3.000 

2.00 

.500 

3.000 

3.000 

3.000 

3.000 

1.000 

4.000 

2.000 

3.000 

4.00 

.333 

.500 

.500 

.500 

1.000 

.250 

1.000 

.500 

2.000 

1.00 

.333 

1.000 

.333 

2.000 

1.000 

.500 

2.000 

1.000 

2.000 

2.00 

.250 

.500 

.333 

.500 

.333 

.333 

.500 

.500 

1.000 

.33 

.333 

.333 

.333 

.500 

.500 

.250 

1.000 

.500 

3.000 

1.00 

lambda:  MAXIMUM):  10.578 
CONSISTENCY  INDEX;  .064 
CONSISTENCY  RATIO;  .04S 

HEIGHT  EIGENVECTOR:  .226  .086  .118  .084  .068  .195  .052  .085  .037  .049 
STANDARDIZED  HEIGHTS:  .065  .025  .034  .024  .020  .056  .015  .024  .011  .014 


EIGENVECTOR  FOR  ELEMENTS  IN  ALL  MATRICES  OF  FACTOR  1 

X3ssaxss3x33assai3s3«sssssaasxcsesss3sxcssssss3ssssss 

HIERARCHICAL  LEVEL:  PAYOFF 
FACTOR:  POTENTIAL  CONTRIBUTION  TO  SDI 

EIGENVECTOR:  .038  .038  .026  .033  .007  .039  .039  .039  .013  .013  .061  .061  .013 

.026  .006  .004  .030  .069  .004  .020  .024  .024  .024  .008  .055  .065  .025  .03 
4  .024  .020  .056  .015  .024  .011  .014 

CHECK— SUM  OF  VECTORS  ELEMENTS  SHOULD  EQUAL  1.0 


AHP  DATA  FOR  MATRIX  NUMBER  5 


FACTOR;  POTENTIAL  CONTRIBUTION  TO  FSED  DECISION 
GROUP :  DEN  PROJECTS 

COMPARISON  MATRIX 


1.000  1.000  7.000  3.000  9.000  9.000  3.000 

1.000  1.000  7.000  3.000  9.000  9.000  3.000 

.143  .143  1.000  .250  4.000  6.000  . ^S0 

.333  .333  4,000  1.000  B.OOO  8.000  1.000 

.111  .111  .167  .125  1.000  3.000  .111 

.111  .111  .167  .125  .333  1.000  .125 

.333  .333  4.000  1,000  9.000  8.000  1.000 

LAMBDAI  MAXIMUM):  7.638 

CaeiSTENCY  INDEX:  .106 
CONSISTENCY  RATIO:  .081 

WEIGHT  EIGENVECTOR:  .302  .302  .063  .143  .025  .018  .146 
STANDARDIZED  WEIGHTS:  .060  .060  .013  .029  .005  .004  .029 


AHP  DATA  FOR  MATRIX  NUFBER  4 


FACTOR;  POTENTIAL  CONTRIBUTION  TO  FSED  DECISION 
GROUP:  KEW  PROJECTS 

COMPARISON  MATRIX 


1.000  9.000  9.000  3.000  3.000  3.000  S.OOO  1.000 

.111  1.000  ,333  .143  .143  .143  .200  .111 

.111  3.000  1.000  1.000  1.000  1,000  5.000  1.000 

.333  7.000  1.000  1.000  1.000  1,000  S.OOO  1.000 

.333  7.000  1.000  1.000  1.000  1,000  S.OOO  1.000 

.333  7.000  1.000  1.000  1.000  1.000  5.000  1.000 

.200  S.OOO  .200  .200  .200  .200  1.000  ,200 

1,000  9.000  1.000  1.000  1.000  1.000  5.000  1.000 

LAMBDA! MAXIMUM):  8.665 

CONSISTENCY  INDEX:  .095 
CONSISTENCY  RATIO:  .067 

WEIGHT  EIGENVECTOR:  .329  .019  .105  .120  .120  .120  .037  .150 
STANDARDIZED  WEIGHTS:  .075  .004  .024  .028  .028  .028  .008  .034 


AHP  DATA  FOR  MATRIX  NUMBER  5 


FACTOR:  POTENTIAL  CONTRIBUTION  TO  FSED  DECISION 
GROUP :  SATKA  PROJECTS 


COMPARISON  MATRIX 


1.000 

3.000 

3.000 

3.000 

3.000 

1.000 

3.000 

3.000 

3.000 

2.00 

.333 

1.000 

2.000 

1.000 

2.000 

.500 

2.000 

1.000 

2.000 

2.00 

.333 

.500 

1.000 

.333 

.500 

.250 

.500 

.500 

2.000 

2.00 

.333 

1.000 

3.000 

1.000 

2.000 

.333 

2.000 

.500 

2.000 

2.00 

.333 

.500 

2.000 

.500 

1.000 

.500 

1.000 

1.000 

2.000 

1.00 

1.000 

2.000 

4.000 

3.000 

2.000 

1.000 

3.000 

2.000 

3.000 

2.00 

.333 

.500 

2.000 

.500 

1.000 

.333 

1.000 

.500 

2.000 

1.00 

.333 

1.000 

2.000 

2.000 

1.000 

.500 

2.000 

1.000 

2.000 

.50 

.333 

.500 

.500 

.500 

.500 

.333 

.500 

.500 

1.000 

.33 

.500 

.500 

.500 

.500 

1.000 

.500 

1.000 

2.000 

3.000 

1.00 

LAhBOAl  MAXIMUM):  10.633 
CCNSISTENCY  INDEX:  .070 
CONSISTENCY  RATIO:  .047 

HEIGHT  EIGENVECTOR;  .202  .103  .058  .101  .073  .182  .065  .094  .042  .080 
STANDARDIZED  HEIGHTS:  .058  .029  .017  .029  .021  .052  .019  .027  .012  .023 

ssavaaamassaaaasasaasssssaaaaamsasssasssasaxsassssss 

EIGENVECTOR  FOR  ELEMENTS  IN  ALL  MATRICES  OF  FACTOR  2 

aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaBsaaaaaBBaaaaaaa 

HIERARCHICAL  LEVEL:  PAYOFF 
FACTOR:  POTENTIAL  CONTRIBUTION  TO  FSED  DECISION 

EIGENVECTOR:  .019  .053  .018  .046  .006  .039  .039  .039  .013  .013  .060  .060  .013 

.029  .005  .004  .029  .075  .004  .024  .028  .028  .028  .008  .034  .058  .029  .01 
7  .029  .021  .052  .019  .027  .012  .023 

CHECK— SUM  OF  VECTORS  ELEMENTS  SHOULD  EQUAL  1.0 


SUM  3  1.0000 

aBBBBBBBBSBBBasBasBBBaBBBBBBBBBBBBSBBBBBBBBBBBBaBBBa 


AHP  DATA  FOR  MATRIX  NUMBER  1 


FACTOR:  POTENTIAL  GENERATION  OF  SPINOFF  TECHNOLOGY 
GROUP:  SABM  PROJECTS 


COMPARISON  MATRIX 


1.000 

.200 

1.000 

.200 

5.000 

5.000 

1.000 

5.000 

1.000 

5.000 

1.000 

.200 

1.000 

.200 

5.000 

5.000 

1.000 

5.000 

1.000 

5.000 

.200 

.200 

.200 

.200 

1.000 

m 


LAMBDA)  MAXIMUM):  5.434 
CONSISTENCY  INDEX:  .108 
CONSISTENCY  RATIO:  .097 

HEIGHT  EIGENVECTOR:  .106  .372  .106  .372  .043 
STANDARDIZED  HEIGHTS:  .015  .053  .015  .053  .006 
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AHP  DATA  FOR  MATRIX  NUMBER  2 


FACTOR: 


POTENTIAL  GENERATION  OF  SPINOFF  TECHNOLOGY 
GROUP:  SLKT  PROJECTS 


COMPARISON  MATRIX 


1.000 

1.000 

.333 

.333 

.333 

1.000 

1.000 

1.000 

.333 

.333 

3.000 

1.000 

1.000 

1.000 

1.000 

3.000 

3.000 

1.000 

1.000 

1.000 

3.000 

3.000 

1.000 

1.000 

1.000 

LAMBDA)  MAXIMUM):  5.151 
CONSISTENCY  INDEX:  .038 
CONSISTENCY  RATIO:  .034 


HEIGHT  EIGENVECTOR:  .093  .122  .230  .278  .278 

STANDARDIZED  HEIGHTS:  .013  .017  .033  .040  .040 


AHP  DATA  FOR  MATRIX  NUMBER  3 


FACTOR: 


POTENTIAL  GENERATION  OF  SPINOFF  TECHNOLOGY 
GROUP:  DEH  PROJECTS 


COMPARISON  MATRIX 


1.000 

1.000 

3.000 

2.000 

9.000 

9.000 

5.000 

1.000 

1.000 

3.000 

2.000 

9.000 

9.000 

5.000 

.333 

.333 

1.000 

.333 

4.000 

4.000 

2.000 

.500 

.500 

3.000 

1.000 

9.000 

9.000 

4.000 

.111 

.111 

.250 

.111 

1.000 

1.000 

.200 

.111 

.111 

.250 

.111 

1.000 

1.000 

.200 

.157 

.157 

.500 

.250 

5.000 

5.000 

1.000 

LAMBDA  (MAXIMUM):  7.250 
CONSISTENCY  INDEX:  .043 
CONSISTENCY  RATIO:  .033 


HEIGHT  EIGENVECTOR:  .292  .292  .095  .205  .024  .024  .059 
STANDARDIZED  HEIGHTS:  .058  .058  .019  .041  .005  .005  .014 


AHP  DATA  FOR  MATRIX  NUWER  4 


FACTOR: 


POTENTIAL  GENERATION  OF  SPINOFF  TECHNOLOGY 
CROUP:  KEH  PROJECTS 


COMPARISON  MATRIX 


1.000 

9.000 

1.000 

3.000 

3.000 

3.000 

9.000 

1.000 

.111 

1.000 

.111 

.250 

.250 

.250 

1.000 

.111 

1.000 

9.000 

1.000 

1.000 

1.000 

1.000 

3.000 

.250 

.333 

4.000 

1.000 

1.000 

1.000 

1.000 

9.000 

1.000 

.333 

4.000 

1.000 

1.000 

1.000 

1.000 

9.000 

1.000 

.333 

4.000 

1.000 

1.000 

1.000 

1.000 

9.000 

1.000 

.111 

1.000 

.333 

.111 

.111 

.111 

1.000 

.111 

1.000 

9.000 

4.000 

1.000 

1.000 

1.000 

9.000 

1.000 

Utf«OA(MAXiriUHl:  8.536 
CONSISTENCY  INDEX:  .077 
CONSISTENCY  RATIO:  .054 

HEIGHT  EIGENVECTOR:  .248  .024  .127  .126  .126  .126  .021  .204 
STANDARDIZED  HEIGHTS:  .057  .005  .029  .029  .029  .029  .005  .047 


AHP  DATA  FOR  MATRIX  NUMBER  5 


FACTOR:  POTENTIAL  GENERATION  OF  SPINOFF  TECHNOLOGY 
GROUP:  SATKA  PROJECTS 

COMPARISON  MATRIX 


1.000 

1.000 

1.000 

.500 

.333 

.333 

.500 

.333 

.500 

1.00 

1.000 

1.000 

1.000 

1.000 

.333 

.250 

.500 

.333 

.500 

.50 

1.000 

1.000 

1.000 

.250 

.250 

.200 

.500 

.200 

.333 

.50 

2.000 

1.000 

4.000 

1.000 

.500 

.333 

.500 

.500 

.500 

2.00 

3.000 

3.oqo 

4.000 

2.000 

1.000 

2.000 

3.000 

.500 

2.000 

3.00 

3.000 

4.000 

5.000 

3.000 

.500 

1.000 

2.000 

.500 

.500 

3.00 

2.000 

2.000 

2.000 

2.000 

.333 

.500 

1.000 

.333 

.500 

1.00 

3.000 

3.000 

5.000 

2.000 

2.000 

2.000 

3.000 

1.000 

2.000 

3.00 

2.000 

2.000 

3.000 

2.000 

.500 

2.000 

2.000 

.500 

1.000 

3.00 

1.000 

2.000 

2.000 

.500 

.333 

.333 

1.000 

.333 

.333 

1.00 

LA^eOA(  MAXIMUM):  10.494 
CONSISTENCY  INDEX:  .055 
CONSISTENCY  RATIO:  .037 


HEIGHT  EIGENVECTOR: 

.049 

.048 

.036 

.079 

.174 

.141 

.078 

.204 

.133 

.058 

STANDARDIZED  WEIGHTS: 

.014 

.014 

.010 

.022 

.050 

.040 

.022 

.058 

.038 

.017 

xaaasaaaMsasaiaasimasaaxsaaxassmasxssMszsmaaMmmmammaaa 

EIGEFtyECTOR  FOR  ELEMENTS  IN  AtL  MATRICES  OF  FACTOR  5 

SSSaSS33aS3a3SXaSS3SSX33S33S333ZSS33S3SS3SSB3a!SS3Ssa 

HIERARCHICAL  LEVEL:  PAYOFF 
FACTOR:  POTENTIAL  GENERATION  OF  SPINOFF  TECHNOLOGY 

EIGENVECTOR:  .015  .053  .015  .053  .006  .013  .017  .033  .040  .040  .058  .058  .019 

.041  .005  .005  .014  .057  .005  .029  .029  .029  .029  .005  .047  .014  .014  .01 
0  .022  .050  .040  .022  .058  .038  .017 


CHECK— SUM  OF  VECTORS  ELEMENTS  SHOULD  EQUAL  1.0 


HIERARCHICAL  LEVEL:  PAYOFF 

NUMBER  OF  FACTORS:  3 

STANOAROIZEO  EIGENVECTOR  -  ALL  ELEMENTS 

.024  .043  .020  .044  .006  .030  .032  .037  .022  .022  .060  .060  .015  .032  .005  .00 
4  .024  .067  .005  .024  .027  .027  .027  .007  .045  .045  .023  .020  .025  .030  . 
049  .019  .036  .020  .018 

CHECK  -  SUM  OF  VECTOR  ELEMENTS  SHOULD  EQUAL  1.0 


SUM  >  1.0000 


APPENDIX  G 
GAMS  OUTPUT 


The  GAMS  nonlinear  programming  package  produces  an 
extensive  and  voluminous  output  listing  for  every  model 
run.  The  GP  model  required  that  model  iterations  be 
performed  for  each  of  the  four  different  budget 
strategies.  The  following  four  pages  contains  a 
condensed  and  curtailed  solution  summary  for  the  model 
runs  at  the  core,  basic,  enhanced,  and  extended  budget 
levels . 


SOLVE 


SUMMARY 


MODEL  6P 

OBJECTIVE 

DEVIATION 

TYPE  LP 

DIRECTION 

MINIMIZE 

SOLVER  BDMLP 

FROM  LINE 

450 

SOLVER  STATUS 

1  NORMAL  CQra>LET10N 

MODEL  STATUS 

1  OPTIMAL 

OBJECTIVE  VALUE 

16.6951 

LONER 

LEVEL 

UPPER  MARGINAL 

EQU  COST 

-INF 

882.600  882.600 

-0.021 

EQU  PAYOFF 

68.259 

68.259 

68.259 

0.527 

EQU  RISK 

r.143 

7.143 

7.143 

-0.301 

.... 

EQU  TIME 

7.793 

7.793 

7.793 

-0.110 

EQU  BALANCE 

52.861 

52.861 

52.861 

0.063 

— — 

EQU  OBJOEF 

• 

• 

• 

-1.000 

COST  COST 

OF 

PROGRAMS  CANNOT  EXCEED  THE  BUDGET 

PAYOFF  GOAL 

NUMBER  1  - 

MAXIMIZE  PAYOFF 

RISK  GOAL 

NUFCER  2  - 

MINIMIZE  RISK 

TIME  GOAL 

NUMBER  3  - 

MINIMIZE  TIME 

BALANCE  GOAL 

NUMBER  4  - 

MAXIMIZE  BALANCE 

O6J0EF  ACHIEVEMENT  FUNCTION 

— —  VAR  X  MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FYBB 


LONER 

LEVEL 

UPPER 

MARGINAL 

B122 

6.000 

6.000 

37.000 

0.027 

B142 

2.000 

15.000 

15.000 

-0.003 

B412 

9.000 

9.000 

28.000 

0.029 

B532 

30.000 

95.000 

95.000 

-0.002 

B612 

2.000 

2.000 

25.000 

0.029 

L008 

5.000 

5.000 

30.000 

0.016 

L212 

2.000 

2.000 

12.000 

0.015 

L503 

5.000 

5.000 

24.000 

0.015 

L721 

2.000 

2.000 

12.000 

0.017 

L723 

2.000 

2.000 

10.000 

0.017 

0044 

1.000 

15.000 

15.000 

-0.009 

0076 

50.000 

260.000 

260.000 

-0 . 008 

0080 

5.000 

5.000 

25.000 

0.024 

D047 

15.000 

15.000 

55.000 

0.006 

D112 

1.000 

1.000 

8.000 

0.043 

0114 

6.000 

6.000 

20.000 

0.047 

0083 

12.000 

12.000 

30.000 

0.009 

K222 

40.000 

187.000 

187.000 

-0.010 

K623 

5.000 

5.000 

28.000 

0.043 

K624 

10.000 

10.000 

45.000 

0.020 

K225 

6.000 

6.000 

20.000 

0.012 

K323 

3.000 

3.000 

50.000 

0.012 

K325 

4.000 

4.000 

25.000 

0.012 

K5Z4 

4.000 

4.000 

25.000 

0.038 

K3Z1 

35.000 

108.600 

204.000 

. 

S271 

25.000 

25.000 

105.000 

0.003 

S051 

15.000 

15.000 

20.500 

0.022 

soil 

3.000 

3.000 

13.300 

0.049 

S052 

15.000 

15.000 

31.000 

0.019 

S053 

3.000 

3.000 

19.200 

0.008 

S243 

3.000 

15.000 

15.000 

-0.003 

S402 

3.000 

3.000 

35.000 

0.019 

S091 

5.000 

5.000 

35.500 

0.005 

S102 

2.000 

2.000 

20.000 

0.018 

S281 

12.000 

12.000 

159.400 

0.020 
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MODEL  GP 

OBJECTIVE 

DEVIATION 

TYPE  LP 

DIRECTION 

MINIMIZE 

SOLVER  BDHLP 

FROM  LINE 

450 

SOLVER  STATUS 

1  NORMAL  COMPLETION 

MODEL  STATUS 

1  OPTIMAL 

OBJECTIVE  VALUE 

9.9588 

LONER 

LEVEL 

UPPER 

MARGINAL 

— —  EQU 

COST 

-INF 

1383.400 

1383.400 

-0.003 

— -  EQU 

PAYOFF 

68.259 

68.259 

68.259 

0.527 

— —  EQU 

RISK 

7.143 

7.143 

7.143 

-0.301 

— —  EQU 

TIME 

7.793 

7.793 

7.793 

-0.110 

— —  EQU 

BALANCE 

52.861 

52.861 

52.861 

0.063 

— —  EQU 

OBJDEF 

. 

. 

. 

-1.000 

COST  COST  OF  PROGRAMS  CANNOT  EXCEED  THE  BUDGET 

PAYOFF  GOAL  NUMBER  1  -  MAXIMIZE  PAYOFF 

RISK  GOAL  NUMBER  2  -  MINIMIZE  RISK 

TIME  GOAL  NUMBER  3  -  MINIMIZE  TIME 

BALANCE  GOAL  NUMBER  4  -  MAXIMIZE  BALANCE 

OBJDEF  ACHIEVEMENT  FUNCTION 


—  VAR  X 


HONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FY88 


LONER  LEVEL  UPPER  MARGINAL 


B122 

B142 

B412 

B532 

B612 

L008 

L212 

L503 

L721 

L7Z3 

0044 

0076 

0080 

D047 

0112 

0114 

D083 

K222 

K623 

K624 

K225 

K323 

K325 

K5Z4 

K321 

S271 

5051 
soil 

5052 

5053 
S243 
S402 
S091 
S102 
S281 


6.000 

6.000 

2.000 

15.000 

9.000 

9.000 

30.000 

95.000 

2.000 

2.000 

5.000 

30.000 

2.000 

12.000 

5.000 

24.000 

2.000 

12.000 

2.000 

10.000 

1.000 

15.000 

50.000 

260.000 

5.000 

5.000 

15.000 

55.000 

1.000 

1.000 

6.000 

6.000 

12.000 

80.000 

40 . 000 

187.000 

5.000 

5.000 

10.000 

10.000 

6.000 

2”. 000 

3.000 

50.000 

4.000 

25.000 

4.000 

4.000 

35.000 

204.000 

25.000 

105.000 

15.000 

15.000 

3.000 

3.000 

15.000 

15.000 

3.000 

19.200 

3.000 

15.000 

3.000 

3.000 

5.000 

35.500 

2.000 

18.700 

12.000 

12.000 

37.000  0.009 

IS. 000  -0.021 

28.000  0.011 

95.000  -0.019 

25.000  0.012 

30.000  -0.002 

12.000  -0.003 

24.000  -0.003 

12.000  -6.020E-4 
10.000  -6.020E-4 

15.000  -0.027 

260.000  -0.026 

25.000  0.006 

55.000  -0.011 

8.000  0.025 

20.000  0.029 

80.000  -0.009 

187.000  -0.028 

28.000  0.025 

45.000  0.003 

20.000  -0.005 

50.000  -0.005 

25.000  -0.006 

25.000  0.020 

204.000  -0.018 

105.000  -0.015 

20.500  0.004 

13.300  0.031 

31.000  0.002 

19.200  -0.009 

15.000  -0.021 

35.000  0.001 

35.500  -0.013 

20.000 

159.400 


0.002 


APPENDIX  H 

AHP  OUTPUT  -  SENSITIVITY  ANALYSIS 

In  Chapter  VII  a  sensitivity  analysis  was  conducted 
on  the  GP  model .  In  order  to  test  the  impact  of 
changes  In  the  achievement  function  coefficient 
weights,  several  modelling  situations  were  envisioned. 
The  function  SINGLE  was  run  In  the  AHP  workspace  on 
each  of  these  four  situations,  and  the  output  from 
these  Iterations  is  contained  on  the  following  pages. 


SITUATION  1 


COMPARISON  MATRIX 


1.000  1.000  5.000  7.000 

1.000  1.000  5.000  7.000 

.ZOO  .200  1.000  2.000 

.143  .143  .500  1.000 

LAMBDA I  MAXIMUM):  4.016 

CONSISTENCY  INDEX:  .005 
CONSISTENCY  RATIO:  .006 

HEIGHT  EIGENVECTOR:  .425  .425  .093  .056 

333sa«saa3a3a3ass3s3a3ss3ss3ss3ass33as=s33a3£sssas 

SITUATION  2 


COMPARISON  MATRIX 


1.000  .500  5.000  7.000 

2.000  1.000  7.000  9.000 

.200  .143  1.000  2.000 

.143  .111  .500  1.000 

LAMBOA( MAXIMUM):  4.040 

CONSISTENCY  INDEX:  .013 
CONSISTENCY  RATIO:  .015 

HEIGHT  EIGENVECTOR:  .330  .542  .079  .048 

33333333333333333333333333333333333333333333333333 

SITUATION  3 

33333333333333333333333333333333333333333333333333 

COMPARISON  MATRIX 


1.000  2.000  .333  7.000 

.500  1.000  .250  5.000 

3.000  4.000  1.000  9.000 

.143  .200  .111  1.000 

LAMBDA  (MAXIMUM):  4.104 
CONSISTENCY  INDEX:  .035 
CONSISTENCY  RATIO:  .039 

HEIGHT  EIGENVECTOR:  .250  .152  .557  .041 


SITUATION  4 


COMPARISON  MATRIX 


1.000  1.000  1.000  1.000 

1.000  1.000  1.000  1.000 

1.000  1.000  1.000  1.000 

1.000  1.000  1.000  1.000 

LAm0A(  MAXIMUM):  4.000 

CONSISTENCY  INDEX;  .000 
CONSISTENCY  RATIO:  .000 

HEIGHT  EIGENVECTOR:  .250  .250  .250  .250 


APPENDIX  I 

GAMS  OUTPUT  -  SENSITIVITY  ANALYSIS 

The  sensitivity  analysis  conducted  In  Chapter  VII 
involved  modelling  four  distinct  situations  Involving 
fluctuations  in  the  achievement  function  coefficient 
weights.  Four  situations  were  run  on  the  GAMS  GP  model 
at  each  of  the  four  budget  strategies,  so  a  total  of 
sixteen  model  Iterations  were  performed  for  the 
sensitivity  analysis.  The  abbreviated  GAMS  output  for 
each  of  these  Iterations  Is  contained  on  the  following 
pages . 
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SOLVE 


SUMMARY 


MODEL  GP 

OBJECTIVE 

DEVIATION 

TYPE  LP 

DIRECTION 

MINIMIZE 

SOLVER  BDMLP 

FROM  LINE 

450 

SOLVER  STATUS 

1  NORMAL 

COMPLETION 

MODEL  STATUS 

1  OPTIMAL 

OBJECTIVE  VALUE 

14.5967 

LONER 

LEVEL 

UPPER 

MARGINAL 

EGU  COST 

-INF 

882.600  882.600 

-0.015 

EQU  PAYOFF 

68.259 

68.259 

68.259 

0.425 

EGU  RISK 

7.143 

7.143 

7.143 

-0.425 

EQU  TIME 

7.793 

7.793 

7,793 

-0 . 093 

EQU  BALANCE 

52.861 

52.861 

52.861 

0.056 

EQU  OBJOEF 

. 

. 

• 

-1.000 

COST 

PAYOFF 

RISK 

TIME 

BALANCE 

OBJOEF 


COST  OF  PROGRAMS  CAhWOT  EXCEED  THE  BUDGET 
GOAL  NU»eER  1  -  MAXIMIZE  PAYOFF 
GOAL  NUMBER  2  -  MINIMIZE  RISK 
GOAL  NUMBER  3  -  MINIMIZE  TIME 
GOAL  NUWER  4  -  MAXIMIZE  BALANCE 
ACHIEVEMENT  FUNCTION 


— -  VAR  X 


MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FY88 


LONER 

LEVEL 

15>PER 

MARGINAL 

B122 

6.000 

6.000 

37.000 

0.029 

B142 

2.000 

15.000 

15.000 

-0.003 

B412 

9.000 

9.000 

28.000 

0.030 

B532 

30.000 

95.000 

95.000 

-0.002 

8612 

2.000 

2.000 

25.000 

0.028 

L008 

5.000 

5.000 

30.000 

0.016 

L212 

2.000 

2.000 

12.000 

0.015 

LSQ3 

5. 000 

S.OOO 

24.000 

O.OIB 

L721 

2.000 

2.000 

12.000 

0.016 

L723 

2.000 

2.000 

10.000 

0.016 

0044 

1.000 

15.000 

15.000 

-0.007 

0076 

50.000 

260.000 

260.000 

-0.007 

0080 

5.000 

5.000 

25.000 

0.023 

0047 

15.000 

15.000 

55.000 

0.005 

0112 

1.000 

1.000 

8.000 

0.045 

0114 

6.000 

6.000 

20.000 

0.050 

0083 

12.000 

12.000 

80.000 

0.006 

K222 

40.000 

187.000 

187.000 

-0.008 

K623 

5.000 

5.000 

28.000 

0.048 

K624 

10.000 

10.000 

45.000 

0.019 

K225 

6.000 

6.000 

20.000 

0.010 

K323 

3.000 

3.000 

50.000 

0.010 

K325 

4.000 

4.000 

25.000 

0.010 

K524 

4.000 

4.000 

25.000 

0.041 

K321 

35.000 

108.600 

204.000 

. 

3271 

25.000 

25.000 

105.000 

0.004 

S051 

15.000 

15.000 

20.500 

0.023 

soil 

3.000 

3.000 

13.300 

0.057 

S05Z 

15.000 

15.000 

31.000 

0.020 

3053 

3.000 

3.000 

19.200 

0.007 

3243 

3.000 

15.000 

15.000 

-0.003 

3402 

3.000 

3.000 

35.000 

0.017 

3091 

5.000 

5.000 

35.500 

0.004 

S102 

2.000 

2.000 

20.000 

0.016 

S281 

12.000 

12.000 

159.400 

0.018 
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SOLVE 


SUMMARY 


MODEL  6P  OBJECTIVE  DEVIATION 

TYPE  LP  DIRECTION  MINIMIZE 

SOLVER  BOMLP  FROM  LINE  450 

***»  SOLVER  STATUS  1  NORMAL  COMPLETION 

****  model  STATUS  1  OPTIMAL 

****  OBJECTIVE  VALUE  12.5762 

LONER  LEVEL  UPPER  MARGINAL 

-  EQU  COST  -INF  1024.100  1029.100  -0.011 

-  EQU  PAYOFF  68.259  68.259  68.259  0.425 

-  EQU  RISK  7.143  7.143  7.143  -0.425 

-  EQU  TIME  7.793  7.793  7.793  -0.093 

-  EQU  BALANCE  52.861  52.861  52.861  0.056 

-  EQU  08JDEF  .  .  .  -1.000 

COST  COST  OF  PROGRAMS  CAt»tOT  EXCEED  THE  BUDGET 

PAYOFF  GOAL  NUFBER  1  -  MAXIMIZE  PAYOFF 

RISK  GOAL  NUFCER  2  -  MINIMIZE  RISK 

TIME  GOAL  NUMBER  3  -  MINIMIZE  TIME 

BALANCE  GOAL  NUMBER  4  -  MAXIMIZE  BALANCE 

OBJOEF  ACHIEVEMENT  FUNCTION 


— -  VAR  X  MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FY88 

LONER  LEVEL  UPPER  MARGINAL 


B122 

6.000 

6.000 

37.000 

0.024 

B142 

2.000 

15.000 

15.000 

-0.007 

3412 

9.000 

9.000 

28.000 

0.026 

B532 

30.000 

95.000 

95.000 

-0.006 

B612 

2.000 

2.000 

25.000 

0.024 

LOOS 

5.000 

5.000 

30.000 

0.012 

L212 

2.000 

2.000 

12.000 

0.011 

LS03 

5.000 

5.000 

24.000 

0.014 

L721 

2.000 

2.000 

12.000 

0.012 

L723 

2.000 

2.000 

10.000 

0.012 

0044 

1.000 

15.000 

15.000 

-0.012 

0076 

50 . 000 

260.000 

260.000 

-0.011 

0080 

5.000 

5.000 

25.000 

0.019 

0047 

15.000 

15.000 

55.000 

0.001 

0112 

1.000 

1.000 

3.000 

0.041 

□  114 

b.OOO 

b.OOO 

20.000 

0.046 

0083 

12.000 

12.000 

30.000 

0.002 

K222 

40.000 

187.000 

187.000 

-0.012 

K623 

5.000 

5.000 

28.000 

0.044 

K624 

10.000 

10.000 

45.000 

0.015 

K225 

6.000 

6.000 

20.000 

0.006 

K323 

3.000 

3.000 

50 . 000 

0.006 

K325 

4.000 

4.000 

25.000 

0.006 

K524 

4.000 

4.000 

25.000 

0.037 

K321 

35.000 

204.000 

204.000 

-0.004 

S271 

25.000 

76.100 

105.000 

S051 

15.000 

15.000 

20.500 

0.019 

SOU 

3.000 

3.000 

13.300 

0.053 

S0S2 

15.000 

15.000 

31.000 

0.016 

S053 

3.000 

3.000 

19.200 

0.003 

S243 

3.000 

15.000 

15.000 

-0.007 

S402 

3.000 

3.000 

35.000 

0.013 

S091 

5.000 

5.000 

35.500 

9.0002E-5 

S102 

2.000 

2.000 

20.000 

0.012 

S281 

12.000 

12.000 

159.400 

0.014 
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SOLVE 


SUMMARY 


MODEL  6P 

OBJECnVE 

DEVIATION 

TYPE  LP 

DIRECTION 

MINIMIZE 

SOLVER  BOMLP 

FROM  LINE 

450 

SOLVER  STATUS 

1  NORMAL 

COMPLETION 

MODEL  STATUS 

I  OPTIMAL 

OBJECTIVE  VALUE 

10.5273 

LONER 

LEVEL 

UPPER 

MARGINAL 

— — 

EQU  COST 

-INF 

1255.400  1255.400 

-0.005 

— — 

EQU  PAYOFF 

68.2S9 

68.259 

68.259 

0.425 

— — 

EQU  RISK 

7.143 

7.143 

7.143 

-0.425 

— — 

EQU  TIME 

7.793 

7.793 

7.793 

-0.093 

— — 

EQU  BALANCE 

52.861 

52.861 

52.861 

0.056 

EQU  OBJDEF 

. 

• 

. 

-1.000 

COST 

PAYOFF 

RISK 

TIME 

BALANCE 

OBJDEF 


— —  VAR  X 


COST  OF  PROGRAMS  CANNOT  EXCEED  THE  BUDGET 
GOAL  NUMBER  1  -  MAXIMIZE  PAYOFF 
GOAL  NUMBER  2  -  MINIMIZE  RISK 
GOAL  NUMBER  3  -  MINIMIZE  TIME 
GOAL  NUMBER  4  -  MAXIMIZE  BALANCE 
ACHIEVEMENT  FUNCTION 


MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FY88 


LONER 

LEVEL 

UPPER 

MARGINAL 

B122 

6.000 

6.000 

37,000 

0.018 

B142 

2.000 

15.000 

15.000 

-0.013 

B412 

9.000 

9.000 

28.000 

0.020 

B532 

30.000 

95.000 

95.000 

-0.012 

B612 

2.000 

2.000 

25.000 

0.018 

LOOS 

5.000 

5.000 

30.000 

0.006 

L212 

2.000 

2.000 

12.000 

0.005 

L503 

5.000 

5.000 

24.000 

0.008 

L721 

2.000 

2.000 

12.000 

0.006 

L723 

2.000 

2.000 

10.000 

0.006 

0044 

1.000 

15.000 

15.000 

-0.018 

0076 

50.000 

260.000 

260.000 

-0.017 

0080 

5.000 

5.000 

25.000 

0.013 

0047 

15.000 

55.000 

55.000 

-0.005 

0112 

1.000 

1.000 

8.000 

0.035 

0114 

6.000 

6.000 

20.000 

0.040 

0083 

12.000 

80.000 

80 . 000 

-0 . 004 

K222 

40.000 

187.000 

187.000 

-0.018 

K623 

5.000 

5.000 

28 . 000 

0.038 

K624 

10.000 

10.000 

45.000 

0.009 

K225 

6.000 

20.000 

20.000 

EPS 

K323 

3.000 

10 . 700 

50 . 000 

K325 

4.000 

25.000 

25.000 

-4.2S0E-4 

K524 

4.000 

4.000 

25.000 

0.030 

K321 

35.000 

204.000 

204.000 

-0.010 

S271 

25.000 

105.000 

105.000 

-0.006 

S051 

15.000 

15.000 

20.500 

0.013 

soil 

3.000 

3.000 

13.300 

0.047 

S052 

15.000 

15.000 

31.000 

0.010 

S053 

3.000 

19.200 

19.200 

-0.003 

S243 

3.000 

15.000 

15.000 

-0.013 

S402 

3.000 

3.000 

35.000 

0.007 

S091 

5.000 

35.500 

35.500 

-0.006 

S102 

2.000 

2.000 

20.000 

0.006 

S281 

12.000 

12.000 

159.400 

0.008 

150 


MODEL  GP  OBJECTIVE  DEVIATION 

type  lp  direction  minimize 

SOLVER  BDMLP  FROM  LINE  450 

<hhh»  solver  STATTJS  1  NORMAL  COMPLETION 

****  MODEL  STATIJS  1  OPTIMAL 

•wm  OBJECTIVE  VALUE  10.3244 


LONER 

LEVEL 

UPPER 

MARGINAL 

-  EGU  COST 

-IMF 

1304.700 

1383.400 

-  EGU  PAYOFF 

66.259 

66.259 

66.259 

0.425 

-  EGU  RISK 

7.143 

7.143 

7.143 

-0.425 

-  EGU  TIME 

7.793 

7.793 

7.793 

-0.093 

-  EGU  BALANCE 

52.861 

52.861 

52.861 

0.056 

-  EGU  OBJDEF 

. 

. 

. 

-1.000 

COST  COST  OF  PROGRAMS  CAMIOT  EXCEED  THE  BUDGET 

PAYOFF  GOAL  NUFSER  1  -  MAXIMIZE  PAYOFF 

RISK  GOAL  NUMBER  2  -  MINIMIZE  RISK 

TIME  GOAL  NUreER  3  -  MINIMIZE  TIME 

BALANCE  GOAL  NUMBER  4  -  MAXIMIZE  BALANCE 

OBJDEF  ACHIEVEMENT  FUNCTION 


-  VAR  X  MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FY88 


LONER 

LEVEL 

UPPER 

MARGINAL 

B122 

6.000 

6.000 

37.000 

0.013 

B142 

2.000 

15.000 

15.000 

-0.018 

B412 

9.000 

9.000 

28.000 

0.015 

B532 

30.000 

95.000 

95.000 

-0.017 

B612 

2.000 

2.000 

25.000 

0.013 

L008 

5.000 

5.000 

30.000 

7.8100E-4 

L212 

2.000 

12 . 000 

12.000 

-6.900E-5 

L503 

5.000 

5.000 

24.000 

0.003 

L721 

2.000 

2.000 

12.000 

9.4000E-4 

L723 

2.000 

2.000 

10.000 

9.40002-4 

0044 

1.000 

15.000 

15.000 

-0.023 

0076 

50.000 

260.000 

260.000 

-0.022 

0080 

5.000 

5.000 

25.000 

0.008 

0047 

15.000 

55.000 

55.000 

-0.010 

0112 

1.000 

1.000 

8.000 

0.029 

0114 

6.000 

6.000 

20.000 

0.035 

3083 

12.000 

80 . 000 

80 . 000 

-0.009 

<222 

40 . 000 

187.000 

187.000 

-0.023 

<623 

5.000 

5.000 

28.000 

0.033 

<624 

10.000 

10.000 

45.000 

0.004 

<225 

6.000 

20.000 

20.000 

-0.005 

<323 

3.000 

50.000 

50.000 

-0.005 

(325 

4.000 

25.000 

25.000 

-0.006 

(524 

4.000 

4.000 

25.000 

0.025 

(321 

35.000 

204.000 

204.000 

-0.015 

i271 

25.000 

105.000 

105.000 

-0.011 

>051 

15.000 

15.000 

20.500 

0.008 

>011 

3.000 

3.000 

13.300 

0.042 

>052 

15.000 

15.000 

31.000 

0.005 

>053 

3.000 

19.200 

19.200 

-0.008 

i243 

3.000 

15.000 

15.000 

-0.018 

>402 

3.000 

3.000 

35.000 

0.002 

>091 

5.000 

35.500 

35.500 

-0.011 

>102 

2.000 

2.000 

20.000 

5.5600E-4 

>281 

12.000 

12.000 

159.400 

0.003 

SOLVE 


S  U  M  H  A  R  Y 


iV* 

V.I 

*»•? 


MODEL  6P 
TYPE  LP 
SOLVER  SDMLP 


OBJECTIVE  DEVIATION 
DIRECTION  MINIMIZE 
FROM  LINE  450 


SOLVER  STATUS 
MODEL  STATUS 
OBJECTIVE  VALUE 


1  NORMAL  COMPLETION 
1  OPTIMAL 

12.6275 


LONER 

LEVEL 

UPPER 

MARGINAL 

EOU  COST 

-INF 

882.600 

882.600 

-0.010 

EGU  PAYOFF 

68.259 

68.259 

68.259 

0.330 

EQU  RISK 

7.143 

7.143 

7.143 

-0.542 

EQU  TIME 

7.793 

7.793 

7.793 

-0.079 

EQU  BALANCE 

52.861 

52.861 

52.861 

0.048 

EQU  OBJDEF 

. 

. 

. 

-1.000 

COST 

PAYOFF 

RISK 

TIME 

BALANCE 

OBJDEF 


COST  OF  PROGRAMS  CANNOT  EXCEED  THE  BUDGET 
GOAL  NUMBER  1  -  MAXIMIZE  PAYOFF 
GOAL  NUMBER  2  -  MINIMIZE  RISK 
GOAL  NUMBER  3  >  MINIMIZE  TIME 
GOAL  NUMBER  4  -  MAXIMIZE  BALANCE 
ACHIEVEMENT  FUNCTION 


VAR  X 

MONEY 

TO  BE  SPi 

■NT  IN  EAC» 

LONER 

LEVEL 

UPPER 

MARGINAL 

B122 

6.000 

6.000 

37.000 

0.031 

B142 

2.000 

15.000 

15.000 

-0.003 

B412 

9.000 

9.000 

28.000 

0.032 

B532 

30.000 

95.000 

95.000 

-0.002 

8612 

2.000 

2.000 

25.000 

0.027 

L008 

5.000 

5.000 

30.000 

0.016 

L212 

2.000 

2.000 

12.000 

0.016 

L503 

5.000 

5^000 

24.000 

0.021 

L721 

2.000 

2.000 

12.000 

0.015 

L723 

2.000 

2.000 

10.000 

0.015 

0044 

1.000 

15.000 

15.000 

-0.006 

0076 

50.000 

260.000 

260.000 

-0.005 

0080 

5.000 

5.000 

25.000 

0.022 

0047 

15.000 

15.000 

55.000 

0.004 

0112 

1.000 

1.000 

8.000 

0.046 

0114 

6.000 

6.000 

20.000 

0.053 

0083 

12.000 

12.000 

80.000 

0.004 

K222 

40 . 000 

187.000 

187.000 

-0.005 

K623 

5.000 

5.000 

28.000 

0.052 

K624 

10.000 

10.000 

45.000 

0.019 

K225 

6.000 

6.000 

20.000 

0.008 

K323 

3.000 

3.000 

50.000 

0.008 

K325 

4.000 

4.000 

25.000 

0.008 

KS24 

4.000 

4.000 

25.000 

0.043 

K3Z1 

35.000 

108.600 

204.000 

S271 

25.000 

25.000 

105.000 

0.005 

S051 

15.000 

15.000 

20.500 

0.025 

soil 

3.000 

3.000 

13.300 

0.064 

S052 

15.000 

15.000 

31.000 

0.021 

S053 

3.000 

3.000 

19.200 

0.006 

S243 

3.000 

15.000 

15.000 

-0.003 

S40Z 

3.000 

3.000 

35.000 

0.016 

S091 

5.000 

5.000 

35.500 

0.003 

S102 

2.000 

2.000 

20.000 

0.014 

S281 

12.000 

12.000 

159.400 

0.017 

m 

M 

i 


SOL 

V  E 

SUMMARY 

MODEL  6P 

OBJECTIVE 

deviation 

TYPE  LP 

DIRECTION 

MINIMIZE 

SOLVER  BDMLP 

FROM  LINE 

450 

«hh*  solver  status 

1  NORMAL  COMPLETION 

<hhh»  model  status 

1  OPTIMAL 

»«»*  OBJECTIVE  VALUE 

11.5794 

LONER 

LEVEL 

UPPER  MARGINAL 

EGU  COST 

-INF 

1029.100  1029.100 

-0.006 

EGU  PAYOFF 

68.259 

68.259 

68.259 

0.330 

EGU  RISK 

7.14S 

7.143 

7.143 

■0.542 

— —  EGU  TIME 

7.793 

7.793 

7.793 

■0.079 

EGU  BALANCE 
— -  EGU  OBJDEF 

52.861 

52.861 

52.861 

0.048 

1.000 

COST  COST  OF  PROGRMtS  CANNOT  EXCEED  THE  BUDGET 

PAYOFF  GOAL  NUFBER  1  >  HAXIMIZE  PAYOFF 

RISK  GOAL  NUMBER  2  >  MINIMIZE  RISK 

TIME  GOAL  NUMBER  5  -  MINIMIZE  TIME 

BALANCE  GOAL  NUMBER  4  '  MAXIMIZE  BALANCE 

OBJDEF  ACHIEVEMENT  FUNCTION 


— —  VAR  X 


noHEyr  to  be  spent  in  each  program  during  fybb 


LONER 

LEVEL 

lff>PER 

MARGINAL 

B122 

6.000 

6.000 

37.000 

0.027 

B142 

2.000 

15.000 

15.000 

-0.007 

8412 

9.000 

9.000 

28.000 

0.028 

8532 

30.000 

95.000 

95.000 

-0.006 

8612 

2.000 

2.000 

25.000 

0.023 

L008 

5.000 

5.000 

30.000 

0.013 

L212 

2.000 

2.000 

12.000 

0.012 

L503 

5.000 

5.000 

24.000 

0.017 

L721 

'  2.000 

2.000 

12.000 

0.012 

L723 

2.000 

2.000 

10.000 

0.012 

D044 

1.000 

15.000 

15.000 

-0.010 

DO  76 

50.000 

260.000 

260.000 

-0.009 

D080 

5.000 

5.000 

25.000 

0.018 

D047 

15.000 

15.000 

55.000 

3.8600E-4 

D112 

1.000 

1.000 

3.000 

0.043 

D114 

6.000 

6.000 

20.000 

0.049 

3083 

12.000 

32.600 

30.000 

, 

^222 

40.000 

187.000 

187.000 

-0.009 

(623 

5.000 

5.000 

28.000 

0.049 

(624 

10 . 000 

10.000 

45.000 

0.015 

(225 

6.000 

6.000 

20.000 

0.005 

(323 

3.000 

3.000 

50.000 

0.005 

(325 

4.000 

4.000 

25.000 

0.004 

(524 

4.000 

4.000 

25.000 

0.040 

(321 

35.000 

204.000 

204.000 

-0.004 

5271 

25.000 

25.000 

105.000 

0.002 

5051 

15.000 

15.000 

20.500 

0.021 

>011 

3.000 

3.000 

13.300 

0.061 

5052 

15.000 

15.000 

31.000 

0.017 

5053 

3.000 

3.000 

19.200 

0.002 

>243 

3.000 

15.000 

15.000 

-0.007 

>402 

3.000 

3.000 

35.000 

0.012 

>091 

5.000 

35.500 

35.500 

-9.600E-5 

>102 

2.000 

2.000 

20.000 

0.011 

5281 

12.000 

12.000 

159.400 

0.013 

w- 


SOL 

iA 

ttl 

> 

U  M  H  A  R  Y 

t 

MODEL  GP 

OBJECTIVE 

DEVIATION 

TYPE  LP 

DIRECTION 

MINIMIZE 

SOLVER  BDMLP 

FROM  LINE 

450 

SOLVER  STATUS 

1  NORMAL 

COMPLETION 

MODEL  STATUS 

1  OPTIMAL 

OBJECTIVE  VALUE 

10.3446 

LONER 

LEVEL 

UPPER  MARGINAL 

EQU  COST 

-INF 

1255.400  1255.400 

-0.002 

— — 

EQU  PAYOFF 

68.259 

68.259 

68.259 

0.330 

— — 

EQU  RISK 

7.143 

7.143 

7.143 

-0.542 

— — 

EQU  TIME 

7.793 

7.793 

7.793 

-0.079 

____ 

EQU  BALANCE 

52.861 

52.861 

52.861 

0.048 

EQU  OBJDEF 

. 

• 

. 

-1.000 

COST 

PAYOFF 

RISK 

TIME 

BALANCE 

OBJDEF 


--  VAR  X 


COST  OF  PROGRAMS  CA^tK)T  EXCEED  THE  BUDGET 
GOAL  NUMBER  1  -  MAXIMIZE  PAYOFF 
GOAL  NUMBER  2  >  MINIMIZE  RISK 
GOAL  NUMBER  3  -  MINIMIZE  TIME 
GOAL  NUMBER  4  -  MAXIMIZE  BALANCE 
ACHIEVEMENT  FUNCTION 


MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FY88 


LONER 

LEVEL 

UPPER 

MARGINAL 

B122 

6.000 

6.000 

37.000 

0.022 

B142 

2.000 

15.000 

15.000 

-0.011 

B412 

9.000 

9.000 

28.000 

0.023 

B532 

30.000 

95.000 

95.000 

-0.010 

B612 

2.000 

2.000 

25.000 

0.018 

L008 

5.000 

5.000 

30.000 

0.008 

L212 

2.000 

2.000 

12.000 

0.007 

L503 

5.000 

5.000 

24.000 

0.012 

L721 

2.000 

2.000 

12.000 

0.007 

L723 

2.000 

2.000 

10.000 

0.007 

0044 

1.000 

15.000 

15.000 

-0.014 

0076 

50.000 

260.000 

260.000 

-0.014 

0080 

5.000 

5.000 

25.000 

0.014 

0047 

15.000 

55.000 

55.000 

-0 . 004 

0112 

1.000 

1.000 

8.000 

0.038 

0114 

6.000 

6.000 

20.000 

0.045 

0083 

12.000 

80.000 

80.000 

-0.005 

K222 

40 . 000 

187.000 

167.000 

-0.014 

K623 

5.000 

5.000 

28.000 

0.044 

K624 

10.000 

10.000 

45.000 

0.011 

K225 

6.000 

20.000 

20.000 

EPS 

K323 

3.000 

10.700 

50.000 

K325 

4.000 

25.000 

25.000 

-5.420E-4 

K524 

4.000 

4.000 

25.000 

0.035 

K321 

35.000 

204.000 

204.000 

-0.008 

S271 

25.000 

105.000 

105.000 

-0.003 

S051 

15.000 

15.000 

20.500 

0.016 

SOU 

3.000 

3.000 

13.300 

0.056 

S052 

15.000 

15.000 

31.000 

0.012 

S053 

3.000 

19.200 

19.200 

-0.002 

S243 

3.000 

15.000 

15.000 

-0.011 

S402 

3.000 

3.000 

35.000 

0.008 

S091 

5.000 

35.500 

35.500 

-0.005 

S102 

2.000 

2.000 

20.000 

0.006 

S281 

12.000 

12.000 

159.400 

0.009 

15^ 


SOLVE 


SUMMARY 


MODEL 

GP 

OBJECTIVE 

DEVIATION 

TYPE 

LP 

DIRECTION 

MINIMIZE 

SOLVER 

BOMLP 

FROM  LINE 

450 

SOLVER 

STATUS 

1  NORMAL  COMPLETION 

MHH* 

MODEL  : 

STATUS 

X  OPTIMAL 

MHHt 

OBJECTIVE  VALUE 

12.1938 

LONER 

LEVEL 

UPPER  MARGINAL 

•  ••• 

EGU  COST 

-INF 

882.600  882.600 

-0.003 

EQU  PAYOFF 

68.259 

68.259 

68.259 

0.250 

EQU  RISK 

7.X43 

7.143 

7.143 

-0.152 

EQU  TIME 

7.793 

7.793 

7.795 

-0.557 

EQU  BALANCE 

52.861 

52.861 

52.861 

0.041 

—  — 

EQU  QBJOEF 

• 

• 

• 

-1.000 

COST 

COST 

OF 

PROGRAMS  CANNOT  EXCEED  THE  BUDGET 

PAYOFF 

GOAL 

NUMBER  1  - 

MAXIMIZE  PAYOFF 

RISK 

GOAL 

NUMBER  2  - 

MINIMIZE  RISK 

TIME 

GOAL 

NUMBER  3  - 

MINIMIZE  TIME 

BALANCE 

GOAL 

NUMBER  4  - 

MAXIMIZE  BALANCE 

OB JOE F 

ACHIEVEMENT  FUNCTION 

—  VAR  X  MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FYBB 


LONER 

LEVEL 

UPPER 

MARGINAL 

B122 

6.000 

6.000 

37.000 

0.031 

B142 

2.000 

15.000 

15.000 

-0.005 

B412 

9.000 

9.000 

28.000 

0.032 

BS32 

30.000 

95.000 

95.000 

-0 . 005 

B612 

2.000 

2.000 

25.000 

0.024 

L008 

5.000 

5.000 

30.000 

0.018 

L212 

2.000 

2.000 

12.000 

0.018 

L503 

5.000 

5.000 

24.000 

0.015 

L721 

2.000 

2.000 

12.000 

0.013 

L723 

2.000 

2.000 

10.000 

0.013 

0044 

1.000 

15.000 

15.000 

-0.008 

0076 

50.000 

260.000 

260.000 

-0 . 003 

D080 

5.000 

5.000 

25.000 

0.022 

0047 

15.000 

20.600 

55.000 

• 

0112 

1.000 

1.000 

8.000 

0.047 

0114 

6.000 

6.000 

20.000 

0.049 

0083 

12.000 

80.000 

80.000 

-9.880E-4 

K222 

40.000 

167.000 

187.000 

-0.001 

K623 

5.000 

5.000 

28.000 

0.025 

K624 

10.000 

10.000 

45.000 

0.028 

K225 

6.000 

6.000 

20.000 

0.014 

K323 

3.000 

3.000 

50.000 

0.014 

K325 

4.000 

4.000 

25.000 

0.014 

K524 

4.000 

4.000 

25.000 

0.024 

K321 

35.000 

35.000 

204.000 

0.002 

S271 

25.000 

25.000 

105.000 

0.004 

S051 

15.000 

15.000 

20.500 

0.017 

soil 

3.000 

3.000 

13.300 

0.058 

S05Z 

15.000 

15.000 

31.000 

0.016 

S053 

3.000 

3.000 

19.200 

0.002 

S243 

3.000 

15.000 

15.000 

-0.005 

S402 

3.000 

3.000 

35.000 

0.019 

S091 

5.000 

5.000 

35.500 

0.003 

S102 

2.000 

2.000 

20.000 

0.018 

S281 

12.000 

12.000 

159.400 

0.018 

SOLVE 


S  U  M  H  A  R  Y 


HOOEL  GP  OBJECTIVE  DEVIATION 

TYPE  LP  DIRECTION  MINIMIZE 

SOLVER  BDMLP  FROM  LINE  450 

WHM  SOLVER  STATUS  1  NORMAL  COMPLETION 

****  MODEL  STATUS  1  OPTIMAL 

***»  OBJECTIVE  VALUE  11.9538 

LONER  LEVEL  UPPER  MARGINAL 


-  EQU  COST  -INF 

-  EQU  PAYOFF  68.259 

-  EQU  RISK  7.143 

-  EQU  TIME  7.793 

-  EQU  BALANCE  52.861 

-  EQU  OBJDEF 


1029.100  1029.100  -0.001 

68.259  68.259  0.250 

7.143  7.143  -0.152 

7.793  7.793  -0.557 

52.861  52.861  0.041 

-1.000 


COST  COST  OF  PROGRAMS  CANNOT  EXCEED  THE  BUDGET 

PAYOFF  GOAL  NUTSER  1  -  MAXIMIZE  PAYOFF 

RISK  GOAL  NUMBER  2  -  MINIMIZE  RISK 

TIME  GOAL  NUMBER  3  -  MINIMIZE  TIME 

BALANCE  GOAL  NUMBER  4  -  MAXIMIZE  BALANCE 

OBJDEF  ACHIEVEMENT  FUNCTION 


■ 


—  VAR  X  MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FY88 

LONER  LEVEL  UPPER  MARGINAL 


B122 

6.000 

6.000 

37.000 

0.029 

B142 

2.000 

15.000 

15.000 

-0.007 

B412 

9.000 

9.000 

28.000 

0.030 

B532 

30.000 

95.000 

95.000 

-0.007 

B612 

2.000 

2.000 

25.000 

0.022 

LOOS 

5.000 

5.000 

30.000 

0.016 

L212 

2.000 

2.000 

12.000 

0.016 

L503 

5.000 

5.000 

24.000 

0.013 

L721 

2.000 

2.000 

12.000 

0.011 

L723 

2.000 

2.000 

10.000 

0.011 

0044 

1.000 

15.000 

15.000 

-0.010 

0076 

50.000 

260.000 

260.000 

-0.005 

0080 

5.000 

5.000 

25.000 

0.020 

0047 

15.000 

55.000 

55.000 

-0.002 

0112 

1.000 

1.000 

8.000 

0.045 

0114 

6.000 

6.000 

20.000 

0.047 

0083 

12.000 

80.000 

80.000 

-0.003 

K222 

40.000 

187.000 

187.000 

-0.003 

K623 

5.000 

5.000 

28.000 

0.023 

K624 

10.000 

10.000 

45.000 

0.026 

K225 

6.000 

6.000 

20.000 

0.013 

K323 

3.000 

3.000 

50.000 

0.013 

K325 

4.000 

4.000 

25.000 

0.012 

K524 

4.000 

4.000 

25.000 

0.022 

K321 

35.000 

147.100 

204.000 

S271 

25.000 

25.000 

105.000 

0.002 

S051 

15.000 

15.000 

20.500 

0.015 

soil 

3.000 

3.000 

13.300 

0.056 

S052 

15.000 

15.000 

31.000 

0.014 

S053 

3.000 

3.000 

19.200 

4.8300E-4 

S243 

3.000 

15.000 

15.000 

-0.007 

S4Q2 

3.000 

3.000 

35.000 

0.017 

S091 

5.000 

5.000 

35.500 

0.001 

S102 

2.000 

2.000 

20.000 

0.016 

S281 

12.000 

12.000 

159.400 

0.016 

157 


SOLVE 


S  U  M  H  A  R  Y 


■’Sp 

'  Vl! 

Sc 

cc 


I 


MODEL  CP 
TYPE  LP 
SOLVER  BDMLP 

»**«  SOLVER  STATUS 

*«*«  model  status 

***•  OBJECTIVE  VALUE 


EQU  COST 
EQU  PAYOFF 
EQU  RISK 
EQU  TIME 
EQU  BALANCE 
EQU  OBJDEF 


OBJECTIVE  DEVIATION 
DIRECTION  MINIMIZE 
FROM  LINE  450 

1  NORMAL  COMPLETION 
1  OPTIMAL 

11.8754 

LONER  LEVEL  UPPER  MARGINAL 


-INF 

68.259 

7.143 

7.793 

52.861 


1102.200 

68.259 

7.143 

7.793 

52.661 


1255.400 

68.259 

7.143 

7.793 

52.661 


0.250 
-0 . 152 
-0.557 
0.041 
-1.000 


COST 

PAYOFF 

RISK 

TIME 

BALANCE 

OBJDEF 


— —  VAR  X 


COST  OF  PROGRAMS  CANNOT  EXCEED  THE  BUDGET 
GOAL  NUMBER  1  -  MAXIMIZE  PAYOFF 
GOAL  NUMBER  2  -  MINIMIZE  RISK 
GOAL  NUMBER  3  -  MINIMIZE  TIME 
GOAL  NUMBER  4  -  MAXIMIZE  BALANCE 
ACHIEVEMENT  FUNCTION 


MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FY88 


LONER 

LEVEL 

UPPER 

MARGINAL 

B122 

6.000 

6.000 

37.000 

0.028 

B142 

2.000 

15.000 

15.000 

-0.009 

B412 

9.000 

9.000 

28.000 

0.028 

BS32 

30.000 

95.000 

95.000 

-0.008 

B612 

2.000 

2.000 

25.000 

0.021 

LOOS 

5.000 

5.000 

30.000 

0.015 

L212 

2.000 

2.000 

12.000 

0.015 

LS03 

5.000 

5.000 

24.000 

0.011 

L721 

2.000 

2.000 

12.000 

0.010 

L72$ 

2.000 

2.000 

10.000 

0.010 

D044 

1.000 

15.000 

15.000 

-0.011 

0076 

50 . 000 

260.000 

260.000 

-0.006 

0080 

5.000 

5.000 

25.000 

0.019 

0047 

15.000 

55.000 

55.000 

-0.003 

0112 

1.000 

1.000 

8.000 

0.043 

□  114 

6.000 

6.000 

20.000 

0.045 

0083 

12.000 

80.000 

80 . 000 

-0.004 

K222 

40.000 

187.000 

187.000 

-0.005 

K623 

5.000 

5.000 

28.000 

0.021 

K624 

10.000 

10.000 

45.000 

0.024 

K225 

6.000 

6.000 

20.000 

0.011 

K323 

3.000 

3.000 

50.000 

0.011 

K325 

4.000 

4.000 

25.000 

0.011 

K524 

4.000 

4.000 

25.000 

0.021 

K321 

35.000 

204.000 

204.000 

-0.001 

S271 

25.000 

25.000 

105.000 

8.6800E-4 

S051 

15.000 

15.000 

20.500 

0.014 

soil 

3.000 

*  3.000 

13.300 

0.055 

S052 

15.000 

15.000 

31.000 

0.013 

S053 

3.000 

19.200 

19.200 

-6.970E-4 

S243 

3.000 

15.000 

15.000 

-0.008 

S402 

3.000 

3.000 

35.000 

0.016 

S091 

5.000 

5.000 

35.500 

1.9000E-4 

SIOZ 

2.000 

2.000 

20.000 

0.014 

S281 

12.000 

12.000 

159.400 

0.015 

SOLVE 


S  U  M  H  A  R  Y 


H 


HODEL  6P 
TYPE  LP 
SOLVER  BOMLP 

SOLVER  STATUS 
MODEL  STATUS 
OBJECTIVE  VALUE 


OBJECTIVE  DEVIATION 
DIRECTION  MINIMIZE 
FROM  LINE  450 


1  NORMAL  COMPLETION 
1  OPTIMAL 

11.B754 


LONER 

LEVEL 

UPPER 

MARGINAL 

—  EQU  COST 

-INF 

1102.200 

1385.400 

—  EQU  PAYOFF 

68.259 

68.259 

68.259 

0.250 

—  EGU  RISK 

7.145 

7.145 

7.145 

-0.152 

"  EGU  TIME 

7.79$ 

7.79$ 

7.793 

-0.557 

~  EQU  BALANCE 

52.861 

52.861 

52.861 

0.041 

”  EGU  OBJOEF 

. 

. 

. 

-1.000 

COST 

PAYOFF 

RISK 

TIME 

BALANCE 

OBJOEF 


— -  VAR  X 


COST  OF  PROGRAMS  CANNOT  EXCEED  THE  BUDGET 
GOAL  NUFBER  1  >  MAXIMIZE  PAYOFF 
GOAL  NUMBER  2  -  MINIMIZE  RISK 
GOAL  NUMBER  3  -  MINIMIZE  TIME 
GOAL  NUMBER  4  -  MAXIMIZE  BALANCE 
ACHIEVEMENT  FUNCTION 


MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FY8B 


LONER 

LEVEL 

t5>PER 

MARGINAL 

B122 

6.000 

6.000 

37.000 

0.028 

B142 

2.000 

15.000 

15.000 

-0.009 

B412 

9.000 

9.000 

28.000 

0.028 

B532 

30.000 

95.000 

95.000 

-0.008 

B612 

2.000 

2.000 

25.000 

0.021 

L008 

5.000 

5.000 

30.000 

0.015 

L212 

2.000 

2.000 

12.000 

0.015 

LS03 

5.000 

5.000 

24.000 

0.011 

L721 

2.000 

2.000 

12.000 

0.010 

L725 

2.000 

2.000 

10.000 

0.010 

0044 

1.000 

15.000 

15.000 

-0.011 

0076 

50.000 

260.000 

260.000 

-0.006 

0080 

5.000 

5.000 

25.000 

0.019 

0047 

15.000 

55.000 

55.000 

-0.003 

0112 

1.000 

1.000 

8.000 

0.043 

0114 

6.000 

6.000 

20.000 

0.045 

0085 

12.000 

80.000 

80 . 000 

-0.004 

K222 

40.000 

187.000 

187.000 

-0.005 

K623 

5.000 

5.000 

28.000 

0.021 

K624 

10.000 

10.000 

45.000 

0.024 

K225 

6.000 

6.000 

20.000 

0.011 

K525 

5.000 

3.000 

50.000 

0.011 

K325 

4.000 

4.000 

25.000 

0.011 

K5Z4 

4.000 

4.000 

25.000 

0.021 

K321 

35.000 

204.000 

204.000 

-0.001 

SZ71 

25.000 

25.000 

105-000 

8.6800E-4 

S051 

15.000 

15.000 

20.500 

0.014 

soil 

3.000 

3.000 

13.300 

0.055 

S052 

15.000 

15.000 

31.000 

0.013 

S053 

3.000 

19.200 

19.200 

-6.970E-4 

S243 

3.000 

15.000 

15.000 

-0.008 

S402 

3.000 

3.000 

35.000 

0.016 

SO  91 

5.000 

5.000 

35.500 

I.9000E-4 

S102 

2.000 

2.000 

20.000 

0.014 

S281 

12.000 

12.000 

159.400 

0.015 

ysy  I 

I  fc»4  A 


SOLVE 


S  U  H  H  A  R  Y 


MODEL  GP 

OBJECTIVE 

DEVIATION 

TYPE  LP 

DIRECTION 

MINIMIZE 

SOLVER  BOHLP 

FROM  LINE 

450 

MHHf 

SOLVER  STATUS 

I  NOmAL 

COMPLETION 

MODEL  STATUS 

1  OPTIMAL 

OBJECTIVE  VALUE 

15.7470 

LONER 

LEVEL 

UPPER 

MARGINAL 

EQU  COST 

-INF 

882.600  882.600 

-0.013 

EQU  PAYOFF 

68.259 

68.259 

68.259 

0.250 

— — 

EGU  RISK 

7.I4J 

7.143 

7.143 

-0.250 

EQU  TIME 

7.793 

7.793 

7.793 

-0.250 

EQU  BALANCE 

52.861 

52.861 

52.861 

0.250 

EQU  OBJOEF 

. 

. 

• 

-1.000 

COST  COST  OF  PROGRAMS  CAftJOT  EXCEED  THE  BUDGET 

PAYOFF  GOAL  NUMBER  I  -  MAXIMIZE  PAYOFF 

RISK  GOAL  NUFBER  Z  •  MINIMIZE  RISK 

TIME  GOAL  NUMBER  5  -  MINIMIZE  TIME 

BALANCE  GOAL  NUMBER  4  -  MAXIMIZE  BALANCE 

OBJOEF  ACHIEVEMENT  FUNCTION 


— —  VAR  X  MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FY88 


LONER 

LEVEL 

UPPER 

MARGINAL 

B122 

6.000 

6.000 

37.000 

0.025 

B142 

2.000 

15.000 

15.000 

-0.002 

B412 

9.000 

9.000 

28.000 

0.026 

B532 

30.000 

95.000 

95.000 

-0.003 

B612 

2.000 

2.000 

25.000 

0.020 

L008 

5.000 

5.000 

30.000 

0.014 

L212 

2.000 

2.000 

12.000 

0.014 

L503 

5.000 

5.000 

24.000 

0.014 

L721 

2.000 

2.000 

12.000 

0.012 

L723 

2.000 

2.000 

10.000 

0.012 

0044 

1.000 

15.000 

15.000 

-0.005 

0076 

50.000 

260.000 

260.000 

-0.002 

0080 

5.000 

5.000 

25.000 

0.019 

0047 

15.000 

15.000 

55.000 

0.003 

0112 

1.000 

1.000 

8.000 

0.037 

0114 

6.000 

6.000 

20.000 

0.040 

0083 

12.000 

12.000 

80.000 

0.003 

K222 

40.000 

187.000 

187.000 

-0.004 

K623 

5.000 

5.000 

28.000 

0.029 

K624 

10.000 

10.000 

45.000 

0.021 

K225 

6.000 

6.000 

20.000 

0.012 

K323 

3.000 

3.000 

50.000 

0.012 

K325 

4.000 

4.000 

25.000 

0.011 

K524 

4.000 

4.000 

25.000 

0.025 

K321 

35.000 

108.600 

204.000 

S271 

25.000 

25.000 

105.000 

0.003 

S051 

15.000 

15.000 

20.500 

0.017 

soil 

3.000 

3.000 

13.300 

0.047 

S052 

15.000 

15.000 

31.000 

0.015 

S053 

3.000 

3.000 

19.200 

0.004 

S243 

3.000 

15.000 

15.000 

-0.001 

S402 

3.000 

3.000 

35.000 

0.016 

S091 

5.000 

5.000 

35.500 

0.002 

S102 

2.000 

2.000 

20.000 

0.014 

S281 

12.000 

12.000 

159.400 

0.016 
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MODEL  GP  OBJECTIVE  DEVIATION 

TYPE  LP  DIRECTION  MINIMIZE 

SOLVER  BDMLP  FROM  LINE  450 

«HHt  SOLVER  STATUS  1  NORMAL  COMPLETION 

**#»  MODEL  STATUS  1  OPTIMAL 

«**«  OBJECTIVE  VALUE  13.9388 

LOHER  LEVEL  UPPER  MARGINAL 

-  EQU  COST  -INF  1029.100  1029.100  -0.010 

-  EGU  PAYOFF  68.259  68.259  68.259  0.250 

- EQU  RISK  7.143  7.143  7.143  -0.250 

-  EQU  TIME  7.793  7.793  7.793  -0.250 

-  EQU  BALANCE  52.861  52.861  52.861  0.250 

-  EQU  OBJDEF  .  -1.000 

COST  COST  OF  PROGRAMS  CANNOT  EXCEED  THE  BUDGET 

PAYOFF  GOAL  NUMBER  1  -  MAXIMIZE  PAYOFF 

RISK  GOAL  NUMBER  2  -  MINIMIZE  RISK 

TIME  GOAL  NUMBER  3  -  MINIMIZE  TIME 

BALANCE  GOAL  NUMBER  4  -  MAXIMIZE  BALANCE 

OBJDEF  ACHIEVEMENT  FUNCTION 


— —  VAR  X  MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FY8S 


LONER 

LEVEL 

UPPER 

MARGINAL 

B122 

6.000 

6.000 

37.000 

0.022 

B142 

2.000 

15.000 

15.000 

-0.004 

B412 

9.000 

9.000 

28.000 

0.023 

B532 

30.000 

95.000 

95.000 

-0.005 

B612 

2.000 

2.000 

25.000 

0.017 

LOOS 

5.000 

5.000 

30.000 

0.011 

L212 

2.000 

2.000 

12.000 

0.011 

L503 

5.000 

5.000 

24.000 

0.011 

L721 

2.000 

2.000 

12.000 

0.009 

L723 

2.000 

2.000 

10.000 

0.009 

0044 

1.000 

15.000 

15.000 

-0.008 

0076 

50.000 

260.000 

260.000 

-0.005 

0080 

5.000 

5.000 

25.000 

0.016 

0047 

15.000 

15.000 

55.000 

2.5000E-4 

0112 

1.000 

1.000 

8.000 

0.034 

0114 

a.  000 

a.  000 

20.000 

0.037 

0083 

12.000 

32.600 

30.000 

K2Z2 

40.000 

187.000 

187.000 

-0.007 

K623 

5.000 

5.000 

28.000 

0.026 

K624 

10.000 

l.O.OOO 

45.000 

0.018 

K225 

6.000 

6.000 

20.000 

0.009 

K323 

3.000 

3.000 

50.000 

0.009 

K325 

4.000 

4.000 

25.000 

0.009 

K524 

4.000 

4.000 

25.000 

0.022 

K3Z1 

35.000 

204.000 

204.000 

-0.003 

S271 

25.000 

25.000 

105.000 

5.0000E-4 

S051 

15.000 

15 . 000 

20.500 

0.014 

soil 

3.000 

3.000 

13.300 

0.044 

S05Z 

15.000 

15.000 

31.000 

0.012 

S053 

3.000 

3.000 

19.200 

0.002 

S243 

3.000 

15.000 

15.000 

-0.004 

S402 

3.000 

3.000 

35.000 

0.013 

SO  91 

5.000 

35.500 

35.500 

-2.500E-4 

S102 

2.000 

2.000 

20.000 

0.011 

S281 

12.000 

12.000 

159.400 

0.013 

SOLVE 


SUMMARY 


MODEL  GP  OBJECTIVE  DEVIATION 

TYPE  LP  DIRECTION  MINIMIZE 

SOLVER  BDMLP  FROM  LINE  450 

****  SOLVER  STATUS  1  NORMAL  COMPLETION 

***»  MODEL  STATUS  1  OPTIMAL 

***«  OBJECTIVE  VALUE  12.0200 

LOWER  LEVEL  UPPER  MARGINAL 

-  EQU  COST  -INF  1255.400  1255.400  -0.001 

-  EQU  PAYOFF  68.259  68.259  68.259  0.250 

-  EQU  RISK  7.143  7.143  7.143  -0.250 

-  EQU  TIME  7.793  7.793  7.793  -0.250 

-  EQU  BALANCE  52.861  52.861  52.861  0.250 

-  EQU  OBJDEF  .  .  ,  -1.000 

COST  COST  OF  PROGRAMS  CANNOT  EXCEED  THE  BUDGET 

PAYOFF  GOAL  NUMBER  1  -  MAXIMIZE  PAYOFF 

RISK  GOAL  NUMBER  2  -  MINIMIZE  RISK 

TIME  GOAL  NUr«ER  3  -  MINIMIZE  TIME 

BALANCE  GOAL  NUMBER  4  -  MAXIMIZE  BALANCE 

OBJDEF  ACHIEVEMENT  FUNCTION 


VAR  X  MONEY  TO  BE  SPENT  IN  EACH  PROGRAM  DURING  FY88 

LOWER  LEVEL  UPPER  MARGINAL 


B122 

6.000 

6.000 

37.000 

0.013 

B142 

2.000 

15 . 000 

15.000 

-0.013 

B412 

9.000 

9.000 

28.000 

0.014 

B532 

30.000 

95.000 

95.000 

-0.014 

B612 

2.000 

2.000 

25.000 

0.008 

LOOS 

5.000 

5.000 

30.000 

0.002 

L212 

2.000 

2.000 

IZ.OQO 

0.002 

L503 

5.000 

5.000 

24.000 

0.002 

L721 

2.000 

2.000 

12.000 

2.5000E-4 

L723 

2.000 

2.000 

10.000 

2.5000E-4 

0044 

1.000 

15.000 

15.000 

-0.017 

0076 

50.000 

260.000 

260.000 

-0.014 

0080 

5.000 

5.000 

25.000 

0.007 

0047 

15.000 

55.000 

55.000 

-0.009 

0112 

1.000 

1.000 

8.000 

0.025 

0114 

o.OOO 

9.000 

20.000 

0.028 

0083 

12.000 

30.000 

80.000 

-0.009 

K222 

40.000 

187.000 

187.000 

-0.016 

K623 

5.000 

5.000 

28.000 

0.017 

K624 

10.000 

10.000 

45.000 

0.009 

K225 

6.000 

20.000 

20.000 

EPS 

K323 

3.000 

10.700 

50 . 000 

. 

K325 

4.000 

25.000 

25.000 

-2.500E-4 

K524 

4.000 

4.000 

25.000 

0.013 

K321 

35.000 

204.000 

204.000 

-0.012 

S271 

25.000 

105.000 

105.000 

-0.008 

S051 

15.000 

15.000 

20.500 

0.005 

soil 

3.000 

3.000 

13.300 

0.035 

S05Z 

15.000 

15.000 

31.000 

0.003 

S053 

3.000 

19.200 

19.200 

-0.007 

S243 

3.000 

15.000 

15.000 

-0.013 

S402 

3.000 

3.000 

35.000 

0.004 

S091 

5.000 

35.500 

35.500 

-0.009 

S102 

2.000 

2.000 

20.000 

0.002 

S281 

12.000 

12.000 

159.400 

0.004 

162 


SOLVE  SUMMARY 


MODEL  6P 

OBJECTIVE 

DEVIATION 

TYPE 

LP 

DIRECTION 

MINIMIZE 

SOLVER  BOMLP 

FROM  LINE 

450 

SOLVER  STATUS 

1  NORMAL  COMPLETION 

MODEL  STATUS 

1  OPTIMAL 

OBJECTIVE  VALUE 

11.9386 

LCHER 

LEVEL 

UPPER  MARGINAL 

EQU 

COST 

-INF 

1312.700  1383.400 

EQU 

PAYOFF 

68.259 

68.259 

68.259 

0.250 

---- 

EQU 

RISK 

7.143 

7.143 

7.143 

-0 . 250 

— 

EQU 

TIME 

7.793 

7.793 

7.793 

-0.250 

EQU 

BALANCE 

52.861 

52.861 

52.861 

0.250 

EQU 

OBJOEF 

• 

• 

• 

-1.000 

COST 

COST 

OF 

PROGRAMS  CANNOT  EXCEED  THE  BUDGET 

PAYOFF 

GOAL 

NUMBER  1  - 

MAXIMIZE  PAYOFF 

RISK 

GOAL 

NUMBER  2  - 

MINIMIZE  RISK 

TIME 

GOAL 

NUMBER  3  - 

MINIMIZE  TIME 

BALANCE 

GOAL 

NUMBER  4  - 

MAXIMIZE  BALANCE 

OSJOEF 

ACHIEVEMENT  FUNCTION 

VAR  X 

MONEY 

TO  BE  Sf 

>ENT  IN  EAC» 

LONER 

LEVEL 

UPPER 

MARGINAL 

B122 

6.000 

6.000 

37.000 

0.012 

B142 

2.000 

15.000 

15.000 

-0.015 

B412 

9.000 

9.000 

28.000 

0.012 

B532 

30.000 

95.000 

95.000 

-0.016 

B612 

2.000 

2.000 

25.000 

0.007 

L008 

5.000 

5.000 

30.000 

0.001 

L212 

2.000 

2.000 

12.000 

S.OOOOE-4 

LS03 

5.000 

5.000 

24.000 

7.SOOOE-4 

L721 

2.000 

12.000 

12.000 

-0.001 

L723 

2.000 

10.000 

10.000 

-0.001 

0044 

1.000 

15.000 

15.000 

-0.018 

0076 

50.000 

260.000 

260.000 

-0.016 

D080 

5.000 

5.000 

25.000 

0.005 

0047 

15.000 

55.000 

55.000 

-0.010 

0112 

1.000 

1.000 

8.000 

0.023 

0114 

6.000 

6.000 

20.000 

0.026 

0083 

12.000 

80.000 

80.000 

-0.010 

K222 

40.000 

187.000 

187.000 

-0.017 

K623 

5.000 

5.000 

28.000 

0.015 

K624 

10.000 

10.000 

45.000 

0.007 

K225 

6.000 

20.000 

20.000 

-0.001 

K323 

3.000 

50.000 

50.000 

-0.001 

K325 

4.000 

25.000 

25.000 

-0.002 

K524 

4.000 

4.000 

25.000 

0.012 

K321 

35.000 

204.000 

204.000 

-0.013 

S271 

25.000 

105.000 

105.000 

-0.010 

S051 

15.000 

15.000 

20.500 

0.003 

soil 

3.000 

3.000 

13.300 

0.034 

S0S2 

15.000 

15.000 

31.000 

0.001 

S053 

3.000 

19.200 

19.200 

-0.009 

S243 

3.000 

15.000 

15.000 

-0.014 

S402 

3.000 

3.000 

35.000 

0.002 

SO  91 

5.000 

35.500 

35.500 

-0.011 

S102 

2.000 

2.000 

20.000 

5.0000E-4 

S281 

12.000 

12.000 

159.400 

0.003 
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